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Abstract. The image of the Gauss map of any oriented isoparametrie hypersurface of the unit 
standard sphere S'""'"^(l) is a minimal Lagrangian submanifold in the eomplex hyperquadric 
QniC). In this paper we show that the Gauss image of a eompaet oriented isoparametric 
hypersurface with g distinct constant principal curvatures in S"^^{1) is a compact monotone 
and cyclic embedded Lagrangian submanifold with minimal Maslov number 2n/g. The main 
result of this paper is to determine completely the Hamiltonian stability of all compact mini- 
mal Lagrangian submanifolds embedded in eomplex hyperquadrics which are obtained as the 
images of the Gauss map of homogeneous isoparametric hypersurfaces in the unit spheres, 
by harmonic analysis on homogeneous spaces and fibrations on homogeneous isoparametric 
hypersurfaces. In addition, the discussions on the exceptional Riemannian symmetric space 
(-Eg: ■ Spin{10)) and the corresponding Gauss image have their own interest. 

Introduction 

In 1990's Oh initialized the study of Hamiltonian minimality and Hamiltonian stability 
of Lagrangian submanifolds in Kahler manifolds ([33], [31], [35]). It provides a constrained 
volume variational problem of Lagrangian submanifolds in Kahler manifolds under Hamiltonian 
deformations. Thus it is natural to study what Lagrangian submanifolds in specific Kahler 
manifolds are Hamiltonian stable. After Oh's pioneer papers, there has been extensive research 
done on Hamiltonian stabilities of minimal or Hamiltonian minimal Lagrangian submanifolds 
in various Kahler manifolds, such as complex Euclidean spaces, complex projective spaces, 
compact Hermitian symmetric spaces, certain toric Kahler manifolds and so on. (See e.g., 
[21 El EH Sni SSI m] and references therein.) In particular, a compact minimal Lagrangian 
submanifold L in a compact homogeneous Einstein-Kahler manifold with positive Einstein 
constant k is Hamiltonian stable if and only if the first (positive) eigenvalue Ai of the Laplacian 
of L with respect to the induced metric satisfies Ai = a. Hence in this case, to determine the 
Hamiltonian stability reduces to calculating the first eigenvalue of the Laplacian, which is an 
important problem in differential geometry. 

On the other hand, isoparametric hypersurfaces are next simple hypersurfaces in spheres 
after geodesic spheres. The theory of isoparametric hypersurfaces in spheres was originated 
by Elie Cartan and well developed afterward. Particularly great progress on the classification 
problem of isoparametric hypersurfaces in spheres were made by the recent work of Cecil- 
Chi- Jensen ([ID]), ImmervoU ([21]), Chi ([121 US]) and Miyaoka ([30]). Among all important 
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results of isoparametric hypersurfaces in spheres, Miinzner ([31], [32]) showed that the number 
g of distinct principal curvatures of an isoparametric hypersurface A^" in S'""''^(l) must be 

= 1, 2, 3, 4, 6 and A^" is always real algebraic in the sense that TV" is defined by a certain real 
homogeneous polynomial of degree g which is called the "Cartan-Miinzner polynomial". 

It is known that the Gauss image of any compact oriented isoparametric hypersurface in 
the unit standard sphere is a smooth compact embedded minimal Lagrangian submanifold in 
the complex hyperquadric and the Gauss map is a covering map with covering transforma- 
tion group Tig ([IHl [26]). Thus it can be expected that the Gauss images of isoparametric 
hypersurfaces in spheres provide a nice class of compact Lagrangian submanifolds embedded 
in complex hyperquadrics and moreover they should play certain roles in symplectic geometry. 
Besides properties of Gauss images discussed in our previous paper [26] , in this paper we show 
(see Theorem 12. ip 

Theorem. The Gauss image of a compact oriented isoparametric hypersurface with g distinct 
constant principal curvature in S'^^^il) is a compact monotone and cyclic embedded Lagrangian 
submanifold with minimal Maslov number 2n/g. 

Recall that all isoparametric hypersurfaces in the unit standard sphere are classified into 
homogeneous ones and non-homogeneous ones. An isoparametric hypersurface A^" in the unit 
standard sphere S"'~^^{1) is called homogeneous if A^" can be obtained as an orbit of a compact 
Lie subgroup of S0{n + 2). Every homogeneous isoparametric hypersurface in a sphere can be 
obtained as a principal orbit of a linear isotropy representation of a compact Riemannian sym- 
metric pair {U,K) of rank 2, due to Hsiang-Lawson ([IH]) and Takagi-Takahashi ([IS]). Only 
in the case of g = 4 there are known to exist non-homogeneous isoparametric hypersurfaces, 
which were discovered first by Ozeki-Takeuchi ( [H] , [12] ) and extensively generalized by Ferus- 
Karcher-Miinzner ([I^)- The purpose of this paper is to determine completely the Hamiltonian 
stability of all compact minimal Lagrangian embedded submanifolds in Qn{C) which are ob- 
tained as the Gauss images of homogeneous isoparametric hypersurfaces in S'^~^^{1). This 
paper is a continuation of [26], where we have already treated the cases of g = 1, 2, 3. 

The main result of this paper is as follows : 

Theorem. Suppose that (U, K) is not of type EIII, that is, (U, K) ^ (Eg, ?7(1) ■ Spin{10)). 
Then the Gauss image L = Q{N) is not Hamiltonian stable if and only if m2 — mi > 3. 
Moreover if {U, K) is of type EIII, then (mi, 7712) = (6, 9) but L = Q{N) is strictly Hamiltonian 
stable. 

This paper is organized as follows: In Section [1] we recall the notions and fundamental prop- 
erties on Hamiltonian minimality, Hamiltonian stability and strictly Hamiltonian stability of 
Lagrangian submanifolds in Kahler manifolds. In Section [2] we briefly explain properties of min- 
imal Lagrangian submanifolds in complex hyperquadrics as the Gauss images of isoparametric 
hypersurfaces in spheres. In Section El we explain the method of eigenvalue computations 
of our compact homogeneous spaces which are the Gauss images of compact homogeneous 
isoparametric hypersurfaces in spheres, and the fibrations on homogeneous isoparametric hy- 
persurfaces by homogeneous isoparametric hypersurfaces. The fibrations are very useful for 
our computation. In Sections H] and [5l we determine the strictly Hamiltonian stability of the 
Gauss images of compact homogeneous isoparametric hypersurfaces with g = Q. In Sections 
|61ITT| we determine the strictly Hamiltonian stability of the Gauss images of compact homoge- 
neous isoparametric hypersurfaces with g = 4. In particular, the discussions on the exceptional 
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Riemannian symmetric space {Eq,U{1) ■ Spin{10)) and the corresponding Gauss image have 
their own interest. 
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1. Hamiltonian minimality and Hamiltonian stability 

Assume that {M,uj, J, g) is a Kahler manifold with the compatible complex structure J 
and Kahler metric g. Let : L — M be a Lagrangian immersion and H denote the mean 
curvature vector field of ip. The corresponding 1-form an '■= i^(H, •) G Q^{L) is called the 
mean curvature form of ip. For simplicity, throughout this paper we assume that L is compact 
without boundary. 

Definition 1.1. Let M be a Kahler manifold. A Lagrangian immersion ip : L ^ M is called 
Hamiltonian minimal (shortly, H-minimal) or Hamiltonian stationary, if it is the critical point 
of the volume functional for all Hamiltonian deformations {^pt}- 

The corresponding Euler-Lagrange equation is San = 0, where 6 is the co-differential oper- 
ator with the respect to the induced metric on L. 

Definition 1.2. An H-minimal Lagrangian immersion ip is called Hamiltonian stable (shortly, 
H-stable) if the second variation of the volume is nonnegative under every Hamiltonian defor- 
mation {ipt}- 

The second variational formula is given as follows (|35]): 
-^Vol {L,^;g)\,^, 

[{A]^a, a) — {R{a), a) — 2{a (8) a ® a^, S) + {au, a)^) dv, 

where A\ denotes the Laplace operator of (L, 'p>*g) acting on the vector space Q^{L) of smooth 
1-forms on L and a := U}{V, ■) G B{L) is the exact 1-form corresponding to an infinitesimal 
Hamiltonian deformation V. Here 

n 

{R{a),a) := Ric^'^ {cj, Cj) a {cj) a (cj) 

for a local orthonormal frame {cj} on L and 

S{X,Y,Z) ■.= uj{B{X,Y),Z) 

for each X,Y,Z G C°°{TL), which is a symmetric 3-tensor field on L defined by the second 
fundamental form i? of L in M. 

For an H-minimal Lagrangian immersion ip : L M, we denote by -E'o(v') the null space of 
the second variation on B^{L), or equivalently the solution space to the linearized H-minimal 
Lagrangian submanifold equation, and we call n{ip) := dimi?o(</5) the nullity of ip. 
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If H^(M, R) = {0}, then any holomorphic Kilhng vector field on M is a Hamiltonian vector 
field, and thus it generates a volume-preserving Hamiltonian deformation of (p. Namely, 

{if* ax \ X is a holomorphic Killing vector field on M} C Eq{lp) C B^(L). 

Set rihki'p) '■— dim{ip*ax | X is a holomorphic Killing vector field on M}, which is called the 
holomorphic Killing nullity of 

Definition 1.3. An H- minimal Lagrangian immersion ip is called strictly Hamiltonian stable 
(shortly, strictly H-stable) if (f is Hamiltonian stable and Uhkif) = n{ip). 

Note that if L is strictly Hamiltonian stable, then L has local minimum volume under each 
Hamiltonian deformation. 

In the case when L is a compact minimal Lagrangian submanifold in an Einstein-Kaher 
manifold M with Einstein constant k, the second variational formula becomes much simpler, 
we see that L is H-stable if and only if the first (positive) eigenvalue Ai of the Laplacian of 
L acting on smooth functions satisfies Ai > k ([33])- On the other hand, it is known that 
the first eigenvalue Ai of the Laplacian of any compact minimal Lagrangian submanifold L in 
a compact homogeneous Einstein-Kahler manifold with positive Einstein constant n has the 
upper bound Ai < k ([37], |38]). In this case, L is H-stable if and only if Ai = k. 

Assume that (M, u, J,g) is a Kahler manifold and G is an analytic subgroup of its automor- 
phism group Aut(M, u, J,g). A Lagrangian orbit L = G- xGMoiG is called a homogeneous 
Lagrangian submanifold of M. An easy but useful observation can be given as follows. 

Proposition 1.1. Any compact homogeneous Lagrangian submanifold in a Kahler manifold 
is Hamiltonian minimal. 

Proof. Since an is an invariant 1-form on L, Sau is a constant function on L. Hence by the 
divergence theorem we obtain Sa^ = 0. □ 

Set 

G := {ae Aut(M, u, J, g) \ a{L) = L}. 
Then G G G and G is the maximal subgroup of Aut(M, cj, J,g) preserving L. Moreover we 
have Uhki'p) = dim(Aut(M, a;, J,g)) — dim(G). 

2. Gauss maps of isoparametric hypersurfaces in a sphere 

2.1. Gauss maps of oriented hypersurfaces in spheres. Let A^" be an oriented hyper- 
surface immersed in the unit standard sphere S'"'"'"^(l) C R""*"^. Denote by x its position vector 
of a point p of N and n the unit normal vector field of A^ in S'"'"'"^(l). It is a fundamental fact 
in symplectic geometry that the Gauss map defined by 

g:N''3p^ x(p) A n{p) ^ [^{p) + v^n(j9)] G (>2(R"+') = Qn{C) 

is always a Lagrangian immersion in the complex hyperquadric Qn{C). Here the complex 
hyperquadric Q„(C) is identified with the real Grassmann manifold Gr2(R"'^^) of oriented 
2-dimensional vector subspaces of R""*"^, which has a symmetric space expression SO{n + 
2)/{SO{2) X SO{n)). 

Let fi'Q^(c) be the standard Kahler metric of Qn{C) induced from the standard inner product 
of R""*"^. Note that the Einstein constant of fl'Q'^(c) is equal to n. Let Hi {i = 1, ■ ■ ■ ,n) denote 
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the principal curvatures of A^" C S'""'"^(l) and H denote the mean curvature vector field of the 
Gauss map Q. Palmer showed the following mean curvature form formula 



(2.1) an = —d j ^^arccotKj j = ci j Im j log]^(l 




=1 / \ \ j=i 

Hence, if A^" is an oriented austere hypersurface in S'""'"^(l), introduced by Harvey-Lawson 
([18]). then its Gauss map Q : A^"^ — )■ Qn{C) is a minimal Lagrangian immersion. In particular, 
since any minimal surface in S''^(l) is austere, its Gauss map is a minimal Lagrangian immersion 
in Q2{C) = S"^ X S"^ ([!])• Note that more minimal Lagrangian submanifolds of complex 
hyperquadrics can be obtained from Gauss maps of certain oriented hypersurfaces in spheres 
through Palmer's formula 



2.2. Gauss maps of isoparametric hypersurfaces in spheres. Now suppose that A^" is 
a compact oriented hypersurface in 5''^"'"^(1) with constant principal curvatures, i.e., isopara- 
metric hypersurface. By Miizner's result ([311 [32]), the number g of distinct principal cur- 
vatures must be 1,2,3,4 or 6, and the distinct principal curvatures have the multiplicities 
mi = ms = ■ ■ ■ , m2 = = ■ ■ ■ . We may assume that mi < m2. It follows from (12.11) that 
its Gauss map Q : A^" — Qn{C) is a minimal Lagrangian immersion. Moreover, the "Gauss 
image" of ^ is a compact minimal Lagrangian submanifold = ^(A^*^) = N"'/Zg embedded in 
Qn{C) so that Q : A^" — Q{N^) = L" is a covering map with the Deck transformation group 



■"a 

Here we mention the following symplectic topological properties of the Gauss images of 
isoparametric hypersurfaces. 

Theorem 2.1. The Gauss image L = Q{N'^) is a compact monotone and cyclic Lagrangian 
submanifold embedded in Qn(C) and its minimal Maslov number is given by 

^ _ 2/2 _ r TTii + m2, if g is even; 
^ g \ 2mi, if g is odd. 

We need to use the following H. Ono's result which generalizes Oh's work [36]. 

Lemma 2.1 ([37]). Let M be a simply connected Kdhler- Einstein manifold with positive scalar 
curvature with a prequantization complex line bundle E. Then any compact minimal La- 
grangian submanifold L in M is monotone and cyclic. Moreover the minimal Maslov number 
T^L of L satisfies the following relation: 

(2.2) niSi = 2 7,,, 

where 

7,, := min{ci(M)(A) | A E H2{M;Z), Ci{M){A) > 0} G Z 
is called the index of a Kdhler manifold M and 

riL := mm{k G Z | A; > 1, i^^{E, V)|l is trivial}. 

Using this lemma and the properties of isoparametric hypersurfaces in a sphere, we shall 
prove Theorem 12.11 

Proof. It follows from Lemma [2?T] and the minimality of the Gauss image L = Q{N''^) that L is 
a monotone and cyclic Lagrangian submanifold in Qn{C). Remark that the index of Qn(C) is 
known as follows ([6]): = n if > 2 and 7^ = 2 if n = 1. So in order to find the minimal 



Maslov number of L, we only need to compute ni- Let A^" be the Legendrian lift of A^" to 
the unit tangent sphere bundle [/T5"+^(l) = \^2(R"+^). Then tt : V2{W+^)\l ^ L = ^(A^") is 
a flat principal fiber bundle with structure group 5*0(2) and the covering map vr : A^" — )■ Q{N^) 
with Deck transformation group coincides with its holonomy subbundle with the holonomy 
group Zg. Let be a complex line bundle over Qn{C) associated with the principal fiber 

bundle TT : 1/2(R"+^) ^ (>2(R"+^) = Qn(C) by the standard action of 50(2) = U{1) on C. 
Then E\l is a fiat complex line bundle over Q{N"') associated with the principal fiber bundle 
TT : V2{W+^)\l ^ ^(A^'') by the standard action of 50(2) = U{1) on C. The tautological 
complex line bundle W over Q„(C) C CP""*"^ is defined by := C(a + ^/^h) for each 
[a+v/^b] e Qn{C). Then E = W if n > 2 and ^^E = W if n = 1. Indeed, ci(>V)(CP^) = 1 
if n > 2. Here, CP^ denotes the set of one-dimensional complex vector subspaces in a 2- 

dimensional isotropic vector subspace of C . For k = 1, ■ ■ ■ , g, the generator e » of the 
holonomy group Zg on £* I i induces the multiplication by e s on® i?!^. Thus the holonomy 

group of ® E\l is generated by e f of Z^,. Hence, ® has non-trivial holonomy for 
k = 1, ■ ■ ■ , g — 1 and ^^E\l has trivial holonomy. Therefore, = g if n > 2 and ra^ = 2 if 
n = 1. Thus the conclusion follows from f l2.2p . □ 

A hypersurface A^'^ in 5"^^(1) is homogeneous if it is obtained as an orbit of a compact 
connected subgroup G of SO{n + 2). Obviously any homogeneous hypersurface in 5'""''^(1) is 
an isoparametric hypersurface. It turns out that A^*^ is homogeneous if and only if its Gauss 
image Q{N^) is homogeneous ([26j). 

Consider 

2 

g-.N'^Bp^ x(p) A n{p) e (>2(R"+') C /\ R"+'. 

Here A R"^^ = 

o(n + 2) can be identified with the Lie algebra of all (holomorphic) Killing 
vector fields on 5""'"^(1) or Gr2(R"'''^). Let t be the Lie subalgebra of o{n + 2) consisting of 
all Killing vector fields tangent to A^" or Q{N'^) and K be a compact connected Lie subgroup 
of SO{n + 2) generated by i. Take the orthogonal direct sum 

2 

/\ R"+2 = I + V, 
where V is a vector subspace of o(r;, + 2). The linear map 

is injective and UhkiQ) = dimV. Then ^(A^") C V and thus 

e?(A^") c(>2(R"+')nv. 

Indeed, for each X G € and each p G A^", (X, x(p) A n{p)) = (Xx(p),n(p)) — (x(p),Xn(p)) = 
2(Xx(p),n(p)) =0. 

Note that Q{N^) is a compact minimal submanifold embedded in the unit hypersphere of V 
and by the theorem of Tsunero Takahashi each coordinate function of V restricted to Q{N"') 
is an eigenfunction of the Laplace operator with eigenvalue n. Then we observe 

Lemma 2.2. n is just the first (positive) eigenvalue oJQ{N^) if and only ifQ{N") C Qn{C) is 
Hamiltonian stable. Moreover the dimension of the vector space V is equal to the multiplicity 
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of the (resp. first) eigenvalue n if and only if Q{N'^) C QniC) is Hamiltonian rigid (resp. 
strictly Hamiltonian stable). 

Next we mention a relationship between the Gauss images Q{N"') of isoparametric hyper- 
surfaces and the intersection Gr2(R.^~^'^) fl V. In |27j we showed that if A^" is homogeneous, 
then giN"") = G^2(R^+^) n V. 

Define a map fi : G^2(R"+^) ^ R-"^^ by 

2 

: C>2(R"+^) 3[W]^aiAhe /\ R"+^ ^ o(n + 2) = I + V. 

The moment map of the action K on G'r2(R"'''^) is given by /ij := tTj o /i : G'r2(R"'''^) — ?■ €, 
where tTj : o(?7, + 2) — )■ t denotes the orthogonal projection onto i. For any p G A^", we have 

k{^{p) A n(p)) C e?(iV") C (>2(R"+') n V = /iri(O). 

It is obvious that A^" is homogeneous if and only if i^(x(j9) An(p)) = Q{N^). In [27] we proved 
its inverse as follows: Assume that ^(A^") = Gr2(R""^^) n V. Then K(x(p) A n(p)) = ^(A^"), 
that is, A^" is homogeneous. Therefore we obtain ([27]) that A^" is not homogeneous if and 
only if 

k{-^{p) A n(p)) c ^(iv") c g;2(R"+') n V = /i--i(O). 

All isoparametric hypersurfaces in spheres are classified into homogeneous one and non- 
homogeneous one. Due to Hsiang-Lawson ([IB]) and Takagi-Takahashi ([H]), any homogeneous 
isoparametric hypersurface in a sphere can be obtained as a principal orbit of the isotropy 
representation of a compact Riemannian symmetric pair {U,K) of rank 2 (see Table [T]). 

Compact homogeneous minimal Lagrangian submanifolds obtained as the Gauss images of 
homogeneous isoparametric hypersurfaces are constructed in the following way (cf. [26]). Let 
u = i + p he the canonical decomposition of u as a symmetric Lie algebra of a symmetric pair 
{U,K) of rank 2 and a be a maximal abelian subspace of p. Define an Adt/- invariant inner 
product ( , )u of u from the Killing-Cartan form of u. Then the vector space p equipped with 
the inner product ( , )u can be identified with the Euclidean space R""*"^ and S'""'"^(l) denotes 
the (n + 1) -dimensional unit standard sphere in p. The linear isotropy action Adp of K on 
p and thus on S'""'"^(l) induces the group action of K on Gr2(p) = Qn{C). For each regular 
element H of anS'"~'^^(l), we get a homogeneous isoparametric hypersurface in the unit sphere 

A^" = iAdpK)H c 5"+^(l) C p = R"+^ 

Its Gauss image is 

= g{N^) =K-[a] = [{Ad,K)a] C G^2(p) = QniC). 

Here A^ and Q{N^) have homogeneous space expressions A^ = K/Kq and Q{N^) = K/K^a], 
where we define 

Ko:={keK\ Adp{k){H) = H} 

= {keK \ Adp{k){H) = H for each H e a}, 
K^:={keK \ Adp(A;)(o) = a}, 

K[a] '■= {k ^ Ka \ Adp{k) : a — > a preserves the orientation of a}. 
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The deck transformation group of the covering map Q : N ^ Q{N^) is equal to K^^]/ Kq = 
W{U, K)/Z2 = Zg, where W{U, K) = KJKq is the Weyl group of {U, K). 

Since we know that AdpK is the maximal compact subgroup of SO{n + 2) preserving 
and/or Q{N"-) ([IH], [22]), in this case its nullity is given as 

UhkiG) = UhkiGiN'')) = dimSOin + 2) - dimK. 



Table 1. Homogeneous isoparametric hypersurfaces in spheres 



g 


Type 


{U,K) 


dirriN 


mi,m2 


K/Ko 


i 


O X 
DULL 


\b X bU[n + I), bUyn + L)) 
yn ^ L) [XV, tp /L\\ 


n 


n 




2 


BDIIx 
BDII 


{S0{p + 2) X SO{n + 2-p), 
S0{p+1) X SO{n + l-p)) 
(1 <p< n - 1) [^1 ©^1] 


n 


p,n — p 


SP X 


3 


AI2 


iSUi3),SOi3))[A2] 


3 


1,1 


50(3) 
Z9+Z9 


3 




iSU{3) X S[/(3),S[/(3))[^2] 


6 


2,2 


5f/ (3) 


3 


AII2 


{SU{6),Sp{3))[A2] 


12 


4,4 


5p(3) 
5p(l)^ 


3 


EIV 


{Ee,F^)[A2] 


24 


8,8 


Spin{8) 


4 




(50(5) X 50(5),50(5))[52] 


8 


2,2 


SO(5) 


4 


AIII2 


{SU{m + 2),S{U{2) X [/(m))) 
(m > 2) [SC72](7n > 3), [S2](?n = 2) 


4m - 2 


2, 

2m - 3 


S(U(2}xU(m)) 


S{U{l)xuil)xU{m-2)) 


4 


BDI2 


iSO{m + 2),SO{2) X 50(m)) 


2m - 2 


1, 


SO(2)xSO(m) 
Z2xSO{m-2) 






(m > 3) [^2] 




m — 2 


4 


CII2 


(Sp(m + 2),5p(2) X Sp{m)) 
(m > 2) [BC2]{m > 3), [S2](m = 2) 


8m - 2 


4, 

4m — 5 


Sp(2}xSp(m} 


Sp{l)xSp(l)xSp{m-~2) 


4 


DIII2 


{SO{W),U{5))[BC2] 


18 


4,5 


(7(5) 

SU{2)xSU{2)xU{l) 


4 


EIII 


{Ee,U{l)-Spin{W))[BC2] 


30 


6,9 


U{l)-Spin(10) 
S^-Spin{6) 


6 


02 


(G2 XG2,G2)[G2] 


12 


2,2 


G2 


6 


G 


(G2,50(4))[G2] 


6 


1,1 


50 (4) 



3. The method of eigenvalue computations for our compact homogeneous 

SPACES 

3.1. Basic results from harmonic analysis on compact homogeneous spaces. First 
we recall the basic theory of harmonic analysis on general compact homogeneous spaces (cf. 
|46]). Let T>{G) be the complete set of all inequivalent irreducible unitary representations of 
a compact connected Lie group G. For a maximal abelian subalgebra t of q, let be the 

set of all roots of i and T,^{G) be its subset of all positive root a G relative to a linear 

order fixed on t. Set 

r(G) := {e e t I exp(0 = e}, 

Z{G) := {A G f I A(0 G 27rZ for each ^ G T{G)}, 
D{G) := {A G Z(G) I (A, a) > for each a G 
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Then there is a bijective correspondence between D{G) 3 A i — > (Va,pa) £ '^(G), where 
(Va, Pa) denotes an irreducible unitary representation of G with the highest weight A equipped 
with a pA(-f^)-invariant Hermitian inner product ( , )vf^- Let ( , )g be an AdG-invariant inner 
product of g. For a compact Lie subgroup H of G with Lie subalgebra (), we take the orthogonal 
direct sum decomposition g = [) + m relative to ( , )g. Set 

(3.1) D{G, H) := {A G D{G) \ {V^)h ^ {0}}, 
where 

(3.2) {Vk)h := {weVK\ p^{a)w = m; (Va G H)}. 

Let A G D{G, H). For each w ® v E (Va)// ® Va, we define a real analytic function fu,(^y on 
G/H by 

(3.3) {fijr,f^^){aH) := {v,pp,{a)w)v^ 

for all aH G G/H. By virtue of the Peter- Weyl's theorem and the Frobenius reciprocity law, 
we have a linear injection 

(3.4) {V^)*H ®V!,3w®v^ U^, G C'^iG/H, C) 
and the decomposition 

(3.5) G°°{G/H,C)= {VaYh^Va. 

A£D{G,H) 

in the sense of C°°-topology. Via the natural homogeneous projection it : G G/H, the 
vector space C°°(G/if, C) of all complex valued smooth functions on G/H can be identified 
with the vector space C°°(G, C)h of all complex valued smooth functions on G invariant under 
the right action of H. Let U{q) be the universal enveloping algebra of Lie algebra g, which is 
identified to the algebra of all left-invariant linear differential operators on C°°(G, C). Let 

U(g)^ := {D G U(0) | Ad{h)D = RhoDo R^-, = D for each h e H} 

be a subalgebra of U(g) consisting of elements fixed by the adjoint action of H. Here define 
{Rhf){u) := fiuh) for / G C~(G',C). For each D G U(g)H, we have D(C°°(G, C)^) C 
G'^{G,C)h- The Casimir operator Cg/h,{ , >£, of {G,H) relative to ( , )g is defined by C = 
Cg/h,{ , )g ■= S"=i(-^j)^! where {Xj | i = 1, ■ ■ ■ , n} is an orthonormal basis of m with respect 
to ( , )g. Then Cg/h,{ , )^ G U(g)i^ and by the AdG-invariance of ( , )g and Schur's Lemma 
there is a non-positive real constant c(A, ( , )g) such that 

(3.6) ^G/H,{ , )gifw(g,v) = C(A, ( , )g)fu,^v 

for each w <^v E {V\)*jj ® V\. The eigenvalue c(A, ( , )g) is given by the Freudenthal's formula 

(3.7) c(A,(,)g) = -(A,A + 25)g, 

where 26 = Eaes+{G) «• 

Now we shall consider our compact homogeneous spaces A^" = K/Kq and L" = Q{N'^) = 
K/Ky^] ([2S]). Let S(f/, K) be the set of (restricted) roots of (u, t) and S+(f/, K) be its subset 
of positive roots. We have the following root decomposition of t: 

t = ^0 + ^75 

7eE+(C/,i^) 
9 



where 

to ■.={X et\[X,a]c a} 

={X G ! I [X,H] = for each H e a}, 
■.={X G t I (adif)^X = {i{H)fX for each H G a}. 
For each 7 G T,~^{U,K), set m(7) := dimt^. Define 
(3.8) m:= t^. 

Then the tangent vector spaces TeKoiK/Ko) and T^K^^^iK / K^a]) can be identified with the 
vector subspace m of t. We can choose an orthonormal basis of m with respect to ( , )u 

{X^, |7eS+(f/,i^),^ = l,2,---,m(7)}. 

Let ( , ) denote the Adm(ii'o)-invariant inner product of m corresponding to the induced metric 
^*9Qt{c) on K/Kq. Thus we know ([SB]) that 

I J^X^,i I 7 e i^), 2 = 1, 2, ■ ■ ■ , m(7) I 

is an orthonormal basis of m relative to ( , ) . 

The Laplace operator A°„ = 6d acting on C°°{K/Ko, C) with respect to the induced metric 
^*9Qt{c) corresponds to the linear differential operator —Cin on C°°{K, C)ko, where C^n g U(t) 
is the Casimir operator relative to the Adm(-K'o)-invariant inner product ( , ) of m defined by 



m(7) 

(3.9) C,.:= 

Note that C^n g U(^)xo because of the Adm(-ft'o)-invariance of ( , ). 

Suppose that K) is irreducible. Let 70 denote the highest root of S(f/, K). For g = 3,4, 
or 6, the restricted root system K) is of type A2, B2, BC2 or G2- Then we know that for 
each 7 G E+(f/,K), 



l7o||u 



'l if S(f/,K) isof type A2, 

1 or 1/3 if S(f/, K) is of type G2, 

1 or 1/2 if S(f/, K) is of type ^2, 

^1,1/2 or 1/4 if S(f/, K) is of type EC's- 



Set 

(3.10) ^tiU,K) := {7 G J:HU,K) I hllf, = hollfj. 

Define a symmetric Lie subalgebra (ui,€i) by 

7es+(c/,x) 7eE+(f/,i^) 
Ui := !i + pi. 

Let Ki and t/i denote connected compact Lie subgroups of K and U generated by ti and Ui. 
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Suppose that T,'^{U,K) is of type BC2. Define 
(3.11) ^t{U,K) := {7 G S+(f/,i^) I hll^ = holl^ or ||7o||^/2}. 

Define a symmetric Lie subalgebra (u2, ^2) by 

76S+(C7,i<-) 76S+(C/,K) 

U2 := !2 + p2- 

Let K2 and f/2 denote connected compact Lie subgroups of K and U generated by ^2 and U2. 
We have the following subgroups of K in each case: 



Set 



if E(t/, /sT) is of type A2; 

if E{U,K) is of type or G2; 



K0CK1CK2C K, if S([/, /sT) is of type BC2. 



C 



K/Ko,{ , )u 



m{7) 



2 



(3.12) 



Ckt_/Ko,{ , )u 



m(7) 

E E(^-)^ 



m(7) 

E E(^- 



7,i/ • 



7GS+{C/,it) »=1 



Then Ck/Ko^Cki/Ko^Ck2/Ko ^ U(t)i<-o and the Casimir operator C^n can be decomposed as 
follows: 

Lemma 3.1. 



2~K/Ko,{ , >„ 
u 



2Ck/Ko,{ , )u 



Crn — < 



K/Ko,{ , )u 



u 



ifnU,K) IS of type A 



2, 



iCk^/Ko,{ , >u ifT.{U,K) is of type G2; 



1 



1 



Ck^/Ko,{ , >u if^iU.K) is of type B2; 



%fj:{U,K) IS of type BC2. 
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3.2. Fibrations on homogeneous isoparametric hypersurfaces by homogeneous 
isoparametric hypersurfaces. For g = A ot Q, {U,K) is of type G2, B2 or BC2 as indi- 
cated at the 3rd column of Table [H 

In the case when ([/, K) is of type B2 or G2, we have one fibration as follows: 



iV" = K/Kq 
K/K, 



In the case when ([/, K) is of type BC2, we have the following two fibrations: 



N"" = K/Kq- 



K/Ko 



K2/K0 



K2/K1 
K/Ki '-^ K/K2 



3.2.1. In case g = 6 and {U,K) = (^2,50(4)), (mi, ma) = (1,1). 

iV6 = K/Ko = SO{4)/{Z2 + Z2) 

K,/Ko = 50(3)/(Z2 + Z2) 



K/Ki = SO{4:)/SO{3) ^ 53 



Here Ui/Ki = SU{3)/ S0{3) is a maximal totally geodesic submanifold oi U/K = G2/S0{A). 
K/Kq = S'0(4)/(Z2 + Z2) is a homogeneous isoparametric hypersurface with g = 6, rrii = 
1712 = 1 and Ki/Kq = SO{3)/{Z2 + Z2) is a homogenous isoparametric hypersurface with 
g = 3, nil = ^2 = 1- 

Remark ([25]). Maximal totally geodesic submanifolds embedded in G2/'S'0(4) are classified 
as SU{3)/SO{3), CP^, ■ S^. 

3.2.2. In case g = 6 and {U,K) = {G2 x G2,G'2), (mi,m2) = (2,2). 
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K^/Ko = SU{3)/T^ 
K/Ki = G2/SU{3) ^ 



Here Ui/Ki = {SU{3) x SU{3))/ SU{3) is a maximal totally geodesic submanifold oi U / K = 
{G2 X G2)/G2. K/Kq = 6*2/^^ is a homogenous isoparametric hypersurface with g = 6, 
rrii = 7712 = 2 and Ki/Kq = SU{3)/T'^ is a homogenous isoparametric hypersurface with 
g = 3, mi = 7712 = 2. 

Remark ([25]). Maximal totally geodesic submanifolds embedded in G2 are classified as 
G2/S0{A), SU{3), ■ S^. 

3.2.3. I7i case g = 4 aTid {U, K) = (50(5) x 50(5), 50(5)), (mi, 7712) = (2, 2). 

= K/Ko = 50(5)/r2 
K^/Ko = SO{A)/T^ 
K/Ki = 50(5)/50(4) = 



Here Ui/Ki = (50(4) x 50(4))/50(4) ^ 50(4) ^ 5^ ■ 5Ms a maximal totally geodesic sub- 
manifold of U/K = (50(5) X 50(5))/50(5) = 50(5). K/Kq = S0{5)/T'^ is a homogeneous 
isoparametric hypersurface with (7 = 4, mi = m2 = 2 and Ki/Kq = 50(4)/T^ = 5^ x 5^ is a 
homogeneous isoparametric hypersurface with g = 2, mi = m2 = 2. 

Remark ([2S])- Maximal totally geodesic submanifolds embedded in 5p(2) = 5pm(5) are clas- 
sified as G^2(R^), 51 ■ 53, 53 X 53, S\ 

3.2.4. /n case c/ = 4 anc? {U, K) = (50(10), t/(5)), (mi,m2) = (4,5). 



N 
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i^i/i^o 



K/K, 



SU{2) X 5f/(2) X U{1) 

_ Ui2)xU(2)xU{l) 
S(7{2)x 5(7(2) X 1/(1) 

i^2/i^l - 



K/Ko 



f/(5) 



[/(2) X U{2) X C/(l) 

Hor-P TT IK - SOi8)xSO(2) ^ 50(8) ^ SOjS) 

Here /72/K2 - f;(4)xc/(i) - ijp^ 

manifold of U/K = SO{10)/U{5), but t/i/fsT; 



(7(4)xt/(l) 
(7(2) X 1/(2) X (7(1) 
i^/i^2 



^(5) 

SU{2) X 5f/(2) X U{1) 

K IK - ^(4)xC/(i) 
-f^2/-f^0 5C/(2)x 5(7(2) xC/(l) 

f/(5) 



f/(4) X [/(I) 

Gr2(R*) is a maximal totally geodesic sub- 
GrofR^) is not a maximal 



50(2)xSO(6) 

_ 50(4)x50(4)x50(2) 
1 ~ (7(2) X (7(2) X (7(1) 
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totally geodesic submanifold of U2/K2- Notice that K/Kq 



Ui5) 



is a homoge- 



5(7(2) X 5(7(2) xf/(l) 

neous isoparametric hypersurface with (7 = 4, (mi, 7712) = (4,5), K2/KQ — c/(4)xt/(i) 



Z2X50(4) 



Ui2)xU(2)xU{l) 
5(7(2) X 5(7(2) xC/(l) 



^(2) ^ U{2) 



5(7(2) X 5(7(2) xC/(l) 

■1712) = (1,4) ai 
S*^ X S*^ is a homogeneous isoparametric hyper- 



50(2)x50(6) ^ homogeneous isoparametric hypersurface with g = A, (mi, 7712) = (1,4) and 



5(7(2) SU{2) 

surface with g = 2, {1711,1712) = (1, 1). 

ReTnark ([25])- Maximal totally geodesic submanifolds embedded in ^S.-. ^ are classified as 



_ f/(5) 
Gr2(R^), Gr2(C5), ^0(5), 5^ x CP^ CP\ 

Remark ([25]). Maximal totally geodesic submanifolds embedded in Gr 2(11^) are classifed as 
(>2(R^), SP-S1 {p + q = 6), CP3. 

3.2.5. /n case g = A and {U,K) = (50(m + 2), 50(2) x SO{m)) {m > 3), (mi, ma) = (l,m - 2). 



iV 



2m-2 



K/Ko 
Ki/Ko 
K/Ki 



SO{2)xSOim) 
Z2x50(m-2) 

50(2)x50(2)x50(m-2) ^ 50(2)x50(2) 
Z2x50(m"2) 

50(2)x50(m) 



Z2 

50 (m) 



50(2)xSO(2)x50(m-2) " 50(2)x50(m-2) 



^ 51 X 51 

(>2(R'") 



Here f/i/Ki = so{2)l^som7o(l-2) - Gr2{'R^) ^ x is not maximal totally geodesic 
submanifold of U/K = so^xsoU = G^2(R™+^). Notice that K/Ko = gSo(S) a 
homogeneous isoparametric hypersurface with g = A, (mi,m2) = (l,m — 2) and Ki/Kq = 

SO{2)xSO(2)xSO(m~2) SO{2)xSO{2) ~ cl Cl • • ^- • T, C 

— Z2x50(m-2) ~ — z^ — = o X o IS a homogeueous isoparametric hypersurface 

with g = 2, (nil, 711,2) = (1)1)- 

Remark ([25]). Maximal totally geodesic submanifolds embedded in Gr2(R'"''~^) (m > 3) are 
classified as C>2(R'"+^), ■ S''{p + g = m), CP^f 1. 

3.2.6. Iti case g = A and {U, K) = {SU{m+2), S{U{2)xU{m)) (m > 2), (mi,m2) = (2,2m-3). 
(i) m = 2, {U, K) = {SU{A), S{U{2) x U{2)), (mi, m2) = (2, 1) 

iV - J\/l^o - 5(C/(l)x(7(l)) 

K IK - S{U{l)xU{l)xU{l)xU{l)) ni ^ qi 
^l/J^O- 5(C/(l)x(7(l)) - 

T^IK^ _ S(U(2)xU(2)) ~ 02 ^ 02 

^/-^l - S'(C/(l)x(7(l)x(7(l)xf/(l)) - ^ 



Here Ui/Ki = 5(^(i)"^''^(ijx[/(i)ij7(i)) = S'^ x S'^ is not a maximal totally geodesic 
submanifold in U/K = siu'{2)xu{2)) - Gr2{C^) = C>2(R^)- Notice that K/Kq 

5(C/(l)x[/(l)) 



5((7(2)xt/(2)) ^ homogeneous isoparametric hypersurface with (7 = 4, (mi,m2) = (2, 1) 
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and Ki/Kq = x is a. homogeneous isoparametric hypersurface with g = 2, 
{nil, 1712) = (1, !)• 
fii) m > 3 



A74m-2 _ _^ _ 5(C/(2)xC/(m)) 

Ko ~ S{U{l)xU{l)xU{m-2)) 



Ki _ S{U(l)xU{l)xU{l)xU{l)xU(m-2)) 
Kq ~ S(U{l)xU{l)xU(rn-2)) 



_K _ S{U{2)xU(m)) 
Ko ~ S(U(l)xU{l)xU(m-2)) 



K2 _ S{U{2)xU{2)xU{m-2)) 
Kq ~ S{U(l)xU{l)xU{Tn-2)) 



fa ^ X CP^ 

K_ _ S(U{2)xU{m)) ^ ^ K_ _ S{U(2)xU{m)) 

Ki ~ S{U{l)xU{l)xU{l)xU{l)xU{m-2)) K2 ~ S{U{2)xU(2)xU{m.-2)) 



Here U2/K2 = Gr2{C^) is not a maximal totally geodesic submanifold oi U/K 



SU[m+2) 



Gr2(C™+^) and Ui/Ki 



S{U{2)xU(2)xU{m-2)) 



S{U{2)xU{m)) ^'2\^ ; a,±i.a wi/ -tvi SCfyCl) X (/(l)x X (7 (1) X (7(m-2)) 

is not a maximal totally geodesic submanifold of U2/K2- Notice that K/Kq 
'^(^(^)^^("')) ig homogeneous isoparametric hypersurface with = 4, (1711,1712) 



S{U{l)xU{l)xU{m-2)) 

(2, 2m — 3), K2/KQ = 5([/(ijx[/(i)x[/(m-2)) ^ homogeneous isoparametric hypersurface 
with (7 = 4, (mi, 7712) = (2, 1) and Ki/Kq = 5*^ x S*^ is a homogeneous isoparametric 
hypersurface with g = 2, (mi,m2) = (1, 1). 



Remark. ([2S]) Maximal totally geodesic submanifolds embedded in Gr2(C™"^^) (m > 3) are 
classified as G'r2(C'"+^), Gr2(R"^+2), CP^ x CP" (p + q = m), HPlf 1. 



3.2.7. In case g = 4 and {U,K) = (S'p(m + 2), Sp{2) x Sp{m)) (m > 2), (1711,1712) = (4,4m-5). 
(i) In case ^ = 4 and {U, K) = {Sp{4:), Sp{2) x Sp{2)) (m = 2), (mi, m2) = (4, 3) 



niU _ T^/T^^ _ 5p(2)x5-p(2) 
iv - J\/J\o - 5p(i)xSp{l) 

^ ,r.. _ Sp{l)xSp{l)xSp{l)xSp{l) ~ r-3 y c-S 
^1/^0 - Sp(l)xSp(l) - ^ ^ 

K IK. — Sp{2)xSp{2) ~ TT pi y -tT pi ~ C4 y o4 

^/-"■l - Sp(l)xSp{l)xSp(l)xSp{l) - 



Here Ui/Ki = sp{i)xZ'§)xZo\xSp{i) - ^ ^ maximal totally geodesic 

submanifold of U/K = ^^J^ = Gr2(H4). Notice that J^/i^o = Zw'^Zm ^ 
homogeneous isoparametric hypersurface with g = 4, {mi, 7712) = (4,3) and Ki/Kq = 
5p(i) X 5p(i) X Sp(i) X 5p(i) ^ 5*3 ^ ^-s jg homogeneous isoparametric hypersurface with 

g = 2, (1111,1712) = (3,3). 
(ii) m > 3 
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Sp{2)xSp{Tn) 



El 



Sp{l)xSp{l)xSp{m-2) 

Sp{l)xSp(l)xSp(l)xSp{l)xSpim-2) 
Spil)xSpll)xSp{m-2) 



K 



Sp(2)xSp{m) 



Sp{l)xSp{l)xSp(m.-2) 



K 



Sp{2)xSp(m) 



K2 



Sp(l)xSp{l)xSp{l)xSp{l)xSp{m-2) 
Sp{4)xSp{m-2) 



^ _K_ 

K2 



K2 _ Sp[2)xSp{2)xSp{m-2) 
Ko — Sp(l)xSp{l)xSp{m-2) 



Sp{2)xSp{m)) 
Sp[2)xSp{2)xSp{m-2) 



Sp{2)xSp(2)xSp{m-2) ~ G'r2(H^) is not a maximal totally geodesic subman- 
^^("^+') ^ Gr2(m+2) but Ui/Ki 



Sp(2)xSp{2)xSp{m-2) 



Here U2/K2 = 

ifold of U/K — Sp(2)xSp{m) — ^' ^V^^ J ^L/^^L — Sp{l)xSp(l)xSp{l)xSp{l)xSp{m~2) 

HP^ X HP^ is a maximal totally geodesic submanifold of U2/K2. Notice that 
K/Ko — o^/i ■> v^s'r)cL-2^ ^ homogeneous isoparametric hypersurface with g — A 



'0 5p{l)x5p(l)xSp{m-2) 

(mi, 7722) 



(4, 4m — 5), K2/K0 = fp[i|x Som ^ homogeneous isoparametric hypersur- 



'0 ~ Sp[l)xSpil) 

face with (7 = 4, (mi, m2) = (4, 3) and Ki/Kq = S*^ x is a homogeneous isoparametric 
hypersurface with g = 2, (1711,1712) = (3,3). 



Remark. ([2S]) Maximal totally geodesic submanifolds embedded in Gr2(H'*) are classified as 
Sp{2), HP2, ■ 5^ X S\ Gr2(C^). 

Maximal totally geodesic submanifolds embedded in Gr2(H"^+^) (m > 3) are classified as 
Gr2(H"^+^), Gr2(C"^+2)^ hP^ x HP"? {p + q = m). 

3.2.8. In case g = A and {U,K) = {Ee,U{l) ■ Spin{10)), (mi, 7712) = (6,9). 



AJ30 _ _^ _ Ujiyspinjio) 
-'^ Ko S''--Spin{6) 



Ki _ ■{Spin(2)-{Spin{2)-Spin{6))) 
Ko ~ 5i-Spin(6) 



K _ U{l)-Spin{10) 
Ko ~ S^-Spin{6) 



K2 
Ki 



K 

Ki 



U{iy{Spin{2ySpin{8)) 
S^-{Spinl2)-{Spin{2)-Spin{6)) 

UjiySpinjlO) ^ K _ 

S^-{Spin{2y{Spin{2)-Spin{6))) 



K2 _ U(l)-{Spin{2)-Spin{S)) 
Ko ~ S'^-Spin{6) 



U{l)-Spin{W) 



K2 U(l)iSpin{2)-Spin{8)) 



Here U2/K2 
U/K 



_ U[l)-Spin(lQ) 

~ U{l)-{Spin{2)-Spin{8)) 

^ but Ui/Ki = 



U{l)-Spin{10) 



Gr2(R}^) is a maximal totally geodesic submanifold of 
gi.fipin(4).spm(6) X is uot a maximal totally 



S'^-(Spin{2)-Spin{2ySpin{6)) 

geodesic submanifold in U2/ K2- Notice that K/ Kq = '^gV.'g^^^^'g"'' is a homogeneous isoparamet 

4, (mi,m2) = (6,9), K2/K, - U{mSvin(2ySp^ni8)) ^ Spini2ySp^nm 



ric hypersurface with g 



^'z2xso{6)^ ^ homogeneous isoparametric hypersurface with g 

TV- /TV- _ S'^iSpin{2)iSpin{2)-Spin{6))) 
^1/^0 - 5i-5pm{6) 

with g = 2, (1711,1112) = (1,1)- 



5i-Spm(6) 



Spin(6) 

4,(1711,1712) = (1,6) and 
5*^ X 5*^ is a homogeneous isoparametric hypersurface 



Remark ([25]). Maximal totally geodesic submanifolds embedded in Eq/U{1) ■ Spin{10) are 
classified as Gr2{li^)/Z2, OP^, x CP\ SO{10)/U{5), Gr2{C^), G^2(R^°)- 
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4. The case {U,K) = {G2 x ^2,^2) 

Let U = G2 X G2, K = {{x,x) e U \ X e G2} and {U, K) is of type Ga- Then Kq = {k e 
K I M{k)H = H for each e 0} ^ TMs a maximal torus of G2 and A^^^ = ^/^^ ^ (^2/7-2 
is a maximal flag manifold of dimension n = 12. Thus its Gauss image is L^^ = Q{N^'^){= 
iV^VZe) = K-[a] = {K/K^,^) c Qi2(C). 

Set ( , )u = — -Bu( ! ); where -Bu( ? ) denotes the Killing-Cartan form of u. Let ( , ) be the 
inner product of m corresponding to the invariant induced metric on from {QniC), Qq'^^^q^^). 

The restricted root system S(f/, K) of type G2, can be given as follows ([7]): 

S(f/, A') ={±(ei - 82) = ±ai, ±(^3 - ei) = ±{ai + 02), 

± (£^3 - £2) = ±(2ai + 02), ±(-2£:i + 62 + £3) = ±"2, 

± {ei - 2e2 + 63) = ±(3ai + 02), 

± {2e3 - El - 62) = ±{3ai + 202) = a}, 

where Il{U, K) = {ai = ei — 62, 0^2 = —2ei + £2 + £3} is its fundamental root system. Here 



l7ll^ = <; 



1 

— if 7 is short, 
24 ' 

- if 7 is long. 



Now Ki = SU{3) and Kq = C = SU{3) C K = G2. 
In Lemma 13.11 the Casimir operator 



3 2 

= iu7ii2^^/^0'<')" ~ ii:rii2^^i/^o,(,>u, 

ll7o|lu ll7o|lu 
of with respect to ( , ) corresponding to — becomes 

Cl =24:Ck/Ko,(,)u - 16Cxi/Xo,(,>u 
=12 Cl^/j^^ - 8C^i//<o 
=12C|^/^g - 6C^^/^^, 

where C^/^o ^^"-^ ^Xi/Xo denote the Casimir operators of K/Kq and Ki/Kq relative to the Kq- 
invariant inner product induced from the Killing-Cartan form of t, respectively, and C]^^^^^ 
denotes the Casimir operator of Ki/Kq relative to the i^o- invariant inner product induced 
from the Killing-Cartan form of ti. 

Let {ai, 02} be the fundamental root system of G2 and {Ai, A2} be the fundamental weight 
system of G2- In our work we frequently use Satoru Yamaguchi's results ([30]) on the spectra 
of maximal flag manifolds. 



Lemma 4.1 (Branching law of {G2,T^) [50]). 

D{K,Ko)=D{G2,T^)= D{G2) 
(4.1) ={A = miAi + m2A2 | mi, m2 G Z, mi > 0, m2 > 0} 

={A = piai+pia2 I Pi,P2 e Z,pi > l,p2 > 1} 
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The eigenvalue formula of the Casimir operator Ck/Kq relative to the inner product induced 
from the Killing- Cartan form of G2 is 

(4.2) - c(A, ( , )gj = j^im^Pi + 3m2P2 + 2pi + 6^2) 

for each A G D{G2,T'^) = D{G2). 
Since 

\ 7: short / 

if the eigenvalue —cl of —Cl satisfies —cl < n = 12, then — ca < 3. 
By using the formula fl4.2l) . we get 

{AeD(G2,T2)|-c(A,(,)gJ<3} 
={0,Ai((pi,p2) = (2,l)),2Ai((pi,p2) = (4,2)),3Ai((pi,p2) = (6,3)), 
A2((pi,P2) = (3,2)),2A2((pi,P2) = (6,4)),Ai + A2((pi,P2) = (5,3)), 
2Ai + A2((pi,P2) = (7,4))}. 

Let {a'^,a2} be the fundamental root system of SU{3) and {A'^,A2} be the fundamental 
weight system of SU{3). For each A G -0(^2, T'^) with — c(A, ( , )g2) < 3, by using the branching 
law of {G2, SU{3)) in [2E], we can determine all irreducible S'f/(3)-submodule V^' with the 
highest weight A' = m'^^A'^ + m2A2 contained in an irreducible G'2-Hiodule V\ as in the following 
table: 



{nil, 7712) 


{Pl,P2) 


— c 


dime Va 


irred. S'f/(3)-submodules (m'^, m'g) 


(1,0) 


(2,1) 


1 

2 


7 


(1,0), (0,1), (0,0) 


(2,0) 


(4,2) 


7 

6 


27 


(2,0), (1,1), (0,2), (1,0), (0,1), 
(0,0) 


(3,0) 


(6,3) 


2 


77 


(3.0) , (2,1), (1,2), (0,3), (2,0), 

(1.1) , (0,2), (1,0), (0,1), (0,0) 


(0,1) 


(3,2) 


1 


14 


(1,1), (1,0), (0,1) 


(0,2) 


(6,4) 


5 
2 


77 


(2, 2), (2,1), (1,2), (2,0), (1,1), 
(0,2) 


(1,1) 


(5,3) 


7 
4 


64 


(2,1), (1,2), (2,0), 2(1,1), (0,2), 
(1,0), (0,1) 


(2,1) 


(7,4) 


8 
3 


189 


(3,1), (2, 2), (1,3), (3,0), 2(2,1), 
2(1,2), (0,3), (2,0),2(1,1), (0,2), 
(1,0), (0,1) 



Since 

«6E{G2) aishort a:long 

5U(3)^ = + E 0"' 

o:long 
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we know that 



• Zg ={a G G2 I Ad(a)(t) = t preserving the orientation of t} 
D{a G SU{3) I Ad(a)(t) = t preserving the orientation of t} 
=T^ ■ Z3. 

Now we use results in SU{3)/T'^, which were aheady treated in the case of g = 3 and m = 2 

my 

Lemma 4.2 (Branching law of (5'[/(3),T^ 



(4.3) 



D{SU{3),T') 
{A' = m\A\ + TTigAg I G Z, m[ > 0} 
{A' = p[a[+p2a'2 \p[eZ,p[>l}, 



where 



m[ = 2p[-p',>0, 



-p[ + 2p', > 0. 



The eigenvalue formula is 
(4.4) 

for each A' G D{SU{3),T^). 



c(A', ( , ),„(3)) = ^im[p[ + m'sPa + 2p[ + 2p^) 



Using Lemma |42l we get that A' = m[A\ + m'^A'^ G D{SU{3),T'^) such that Vxi C Va for 
some A G D{G2,T'^) with — c(A, ( , )g2) < 3 satisfies 

(m;,m'2)G {(1,1), (3,0), (0,3), (2, 2)}. 

By using the formula (14. 4p . we compute the corresponding eigenvalues of Cki/Kq as follows: 





(m;,m2) 


-C' = -C(A', ( , ),„(3)) 


(1,1) 


(1,1) 


1 


(2,1) 


(3,0) 


2 


(1,2) 


(0,3) 


2 


(2,2) 


(2,2) 


8 
3 



Therefore, for all A G D{G2,T^) and all A' G D(5f/(3),T2) such that Va> C \4 and 
— c(A, ( , )g2) < 3, the corresponding eigenvalues of —Cl = — 12C^y^^ + 6C]^^y^^,^ = —12c + 6c' 
are given in the following table: 
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(mi,m2) 


(Pl,P2) 


dime Va 


— c 


(m;,m'2) 


-c' 


-12c + 6c' 


(2,0) 


(4,2) 


27 


Y 
fi 


(1,1) 


1 


8 


(3,0) 


(6,3) 


77 


2 


(1,1) 


1 


18 


(3,0) 


(6,3) 


77 


2 


(3,0) 


2 


12 


(3,0) 


(6,3) 


77 


2 


(0,3) 


2 


12 


(0,1) 


(3,2) 


14 


1 


(1,1) 


1 


6 


(0,2) 


(6,4) 


77 


5 


(1,1) 


1 


24 


(0,2) 


(6,4) 


77 


2 


(2,2) 


8 
8 


14 


(1,1) 


(5,3) 


64 


7 


2(1,1) 


1 


15 


(2,1) 


(7,4) 


189 




2(1,1) 


1 


26 


(2,1) 


(7,4) 


189 




(3,0) 


2 


20 


(2,1) 


(7,4) 


189 




(0,3) 


2 


20 


(2,1) 


(7,4) 


189 


3 


(2,2) 


8 
fi 
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Since A'^ + ^^{{m'l.m^) = (1,1)) corresponds to the complexified adjoint representation of 
SU{3), we see tfiat (V^a/+a^)t2 = and (V^/^^, )t2.Z3 = {0}. Tlien 

A[+A',^DiSU{3),T'-Z,). 

and tlius 

2Ai,A2^D(G2,T2.Z6). 

Now we obtain tliat Q{G2/T'^) C QuiC) is Hamiltonian stable. 

We need to examine whether 3Ai G D{K,K[a]) = D{G2,T^ ■ Zq) or not. Consider 

Since 

^3A'i - Sym^(C^) = spanc{eii ■ ■ Ci-, \ 1 < h < i2 < is < 3}, 
where {ci, 62, 63} is the standard basis of C'^, we get 

(^3a;)t2 = (V^3A'Jt2.Z3 = spanc{ei ■ 62 ■ 63}. 

Similarly, we get Vg'^^ = Sym'^(C'^) and (V^^iJt^ = (Vg^, )r2.z3 with dimension 1. On the other 
hand we know that (V^'+A')r2 — t and (V^' +a' )t2-Z3 = {0}. Hence we get dimc(V3Ai)r2 = 4 

and dimc(V^3AjT2.Z3 = 2. However dimc(F3ljT2.Z6 = 1- In fact, T^-Zg C G2, T^-Zg ^ SU{3), 
■ Z3 C SU{3) and (T^ ■ Zq)/{T'^ ■ Z3) = Z2. Thus there exists an element u e ■ Zq C G2 
with u ^ SU{3) which satisfies Ad{u){SU{3)) C SU{3) and provides the generators of both 
(T2 ■ Z6)/T2 ^ Ze and (T^ ■ Z6)/(T2 ■ Z3) = Z2. Then we observe that p3Ai oAd{u)\sui3) = Psa^ 
and P3Ai(^^)(^3a;) = V'sa- Thus P3aAu){V^j^,Jt^.z^ = {V^j^,Jt^.Zs and (psAi («))^|(f^'^, = 
(P3Ai(ii^))|(y3'^, )y2.z3 = I'i' because e T"^ ■ Z3. Hence we have (V3Ai)t2.Z6 C (V3'^,)t2.z3 © 
(^3A' )t2.Z3 and dim(V3Ai)r2.Z6 = 1- Therefore 3Ai G -0(6*2, ■ Zg) and its multiplicity is 
equal to 1. It follows that 

n{L^^) = dimc(V^3Aj = 77 = 91 - 14 = dim(^0(14)) - dim(G2) = nhk{L^^), 

that is, ^(G'2/T^) C (512(C) is Hamiltonian rigid. 
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Let R.^^ = o(n + 2) = adp(02) + V ^ 52 + V. Then 

2 2 

/\ C^^ = (/\ Ri^)^ = o(n + 2)^ = o(n + 2, C) = e.d,iQ^) + - Ss"" + V^, 

where dim V = 77 and dime V*" = 77. More precisely, we observe that V is a real 77- 
dimensional irreducible G2-Kiodule with (V)r2.Z6 7^ {0}; ^^^^ is a complex 77-dimensional 
G2-niodule with (V)^2.Zg 7^ {0}. Moreover, we have V'-' = Vsa^ with dimc(V)^2.Zg = 1- 
From these arguments we conclude that 

Theorem 4.1. The Gauss image L^^ = Q{G2/T'^) = C Qi2(C) is strictly Hamiltonian 
stable. 

5. The case {U,K) = (^2,50(4)) 

Let U = G2, K = 50(4) and {U,K) is of type G2. Let u = t + p be the orthogonal 
symmetric Lie algebra of (02, 5*0(4)) and a be the maximal abelian subspace of p. Here 
u = 02, t = 5o(4) = su(2) © su(2). Let 

p:K = Spin{A) = SU{2) x SU{2) — yK = 50(4) 

be the universal covering Lie group homomorphism with kernel Z2. 

Recall that the complete set of all inequivalent irreducible unitary representations of SU (2) 
is given by 

V{SU{2)) = {{Vm.,Pm) I m G Z,m > 0}, 
where Vm denotes the complex vector space of complex homogeneous polynomials of de- 
gree m with two variables Zq, Z\ and the representation of SU (2) on Vm is defined by 
{pm{9)f){zo, zi) = f{{zo, zi)g) for each g G SU{2). Set 

(5.1) vlr\zo,z,):=^=L==z^~'z'ieVm (A; = 0, 1, . . . , m) 

y'kl[m — k)l 

and define the standard Hermitian inner product of Vm invariant under pm{SU{2)) such that 
{fQ™"*, . . . , vir^} is a unitary basis of V^- Let (V/ ® Kn, pi Kl pm) denote an irreducible unitary 
representation of SU{2) x SU{2) of complex dimension (/ + l)(m + 1) obtained by taking the 
exterior tensor product of Vi and Vm and then 

{{Vi O Kn, K p„) I /, m e Z, /, m > 0} 

is the complete set of all inequivalent irreducible unitary representations of SU(2) x SU{2). 

The isotropy representation of (G2, 50(4)) is explicitly described as follows (cf. [H]): Sup- 
pose that (/,m) = (3, 1). The real 8-dimensional vector subspace W oiV^® Vi spanned over 
Rby 



{ vf' ^ 




























































(3) 


®t;f^) } 



gives an irreducible orthogonal representation of SU{2) x SU{2) whose complexification is 
V3 ® Vi, i.e. W \s real form of V3 ® Vi. Then the isotropy representation Adp of (G2, 50(4)) 
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is given by Adp op = p^M pi and the vector space p is hnearly isomorphic to W. Moreover a 
corresponds to a vector subspace 

,(3) , „,(3) ^^,(1)^ , jifj3) ^Jl) 

Y 



For each X 
formula holds: 
Lemma 5.1. 



u 



-Ix 



-w 



w 



(3) ^ 

G su(2), the foUowing useful 



[d{p, M pJ{X, Y)] Cvf^ ® ^;]-)±tt\ ® 



={(2z - l)x + (2j - m)y} V-l{v? ® i;f ® C-.O 



(m) 



+ + Im(M) \^ivf\ ® vp±vl 



i+1 ^m-j) 



(5.2) 



(0 



+ \/ — i + 1) Im(iy) v^^(f, 
+ x/(/-i)(i + l) Re(M) 
+ V(/-z)(« + l) Im(n) 
+ V(m-j)(j + 1) Re(w;) (t; 
+ \/{m — + 1) Im(w) 



(m) 



(0 



(0 



,(0 



(m) X 
m— J — 1 J 



Remark. By using the formula (15. 2 p we can check that the real vector subspace W is invariant 
under the action of SU{2) x SU{2) via ps Kl pi. 

Define an orthonormal basis of the real vector space IV = p by 



Hi 
H2 
El 
E2 
E3 

E, 
E^ 



1 
1 

7!' 

1 

1 
1 



,(3) 



+ 7;f ®<0 



,(3) 



(8) 



(3) 



(3) 



,(3) 



(1) (3) 



^1 
,(3) 



3 

(3) 



1 

7!^ 



-1 (4'^®t^o 



(3) ^ 
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Then we have the matrix expression as follows: 

[d(p3Kpi)(X,r)] {H^,H^) 

f-i3x + y) 
V3 Re(n) 

{El, E2, E3, Ei, E5, Eq, 



V3 Im( u) 
Re{w) 





\ 

-(2 Re(u) + Re{w)) 

2 lm{u) + lm{w) 
-73 Re{u) 
\/3 Im( u) 
\ X — y 

The inner product ( , ) corresponding to the metric induced from Q^q'^i^q,-^ is given as follows: 
For (X, X') , (r, Y') e su(2) © su(2) , 

:= {3x + x'){3y + y') 

+ 3 Re(M)Re(w) + (2 Re(n) + Re(n'))(2 Re(u;) + Re(u7')) 

+ 3 Im(M)Im(w) + (2 Im(M) + Im(M'))(2 lm{w) + Im(w')) 

+ Re{u')Re{w') + 3Re(u)Re(M;) 

+ Im(M')Im(u;') + 3Im(n)Im(M;) 

+ (x - x'){y - y') 
= lOxy + 2x'y + 2xy' + 2x'y' 

+ 10 Re(M)Re(u;) + 2 Re{u')Re{w) + 2 Re(M)Re(w;') + 2Re(u')Re(u7') 

+ 10 Im(M)Im(w) + 2 Im(M')Im(w) + 2 Im(M)Im(w') + 2Im(M')Im(w'). 

Thus the Casimir operator of {K,K[a]) relative to the inner product ( , ) is given as follows: 
Cl= ^ (Xi, 0) ■ (Xi, 0) + i (X2, 0) ■ (X2, 0) + i (X3, 0) ■ (X3, 0) 

+ ^ (0,XO-(0,Xi) + ^ (0,X2)-(0,X2) + ^ (0,X3)-(0,X3) 
- (Xi,0)-(0,Xi)- (X2,0)-(0,X2)- (X3,0)-(0,X3), 



where 



-1 











X, 



1 
-1 



X, 











is a basis of su(2) and {(Xi,0), (X2,0), (X3,0), (0,Xi), (0,X2), (0,X3)} is a basis of su(2) 
su(2). Hence, we have the following formula for the Casimir operator: 

Lemma 5.2. 

[d{piMp„,)iCL)]ivf^®vjr^) 

l{l + 2) ^ 5m(m + 2) {2i - l){4a - m) ^ ^ (;) 



+ ^V(z + l)(/-z)a(m-a+l)(-^'^ 



(m) < 

+ ^Vz(/-z + l)(a+l)(m- ® .^S; 
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Set 

Ko := {{A,B)eK \ Ad{p{A, B))H = H for each H ea}. 
Then using this description of the isotropy representation we can compute directly 

^0 



1 0\ /I 

ly ' vo 1 

-1 \ f-l 
-1 J ' I -] 



-i\ /o -1 

1 y) ' 
A / 1 



-1 











-i; ' V 

T 



-1 







-i/'V 



-1 



-1 



-1 



-1 







-V-i 

-v^ 





^ 






In particular, the order of Kq is 8. This result is consistent with ones of [H p.611], [5i p. 
and [IHl p. 573] in topology of transformation group theory. Moreover we obtain 



P 
P 
P 
P 



1 0\ /I 

1 j ' lo 1 



p 



-1 



-i; ' V -1 



-1 



-1 











-i\ /o -1 

1 J ' I 1 



-v-i 
= p 



p 



-1 



-1 



1/ ' V 



iW 1 

-1 oJ'l-1 







-1 



-1 





^ 



p 







-1 



-1 



-v^ 

\/^ 



= Z2 + Z2. 

Hence the order of group Kq is equal to 4 and 

K/Ko = K/Ko = S0{A)/Z2 + Z2. 
For each /, m G Z with /, m > 0, the vector subspace of Vi ® Vm 

:={e &Vi®V^\ [{pi K p^)(A, = e for any {A, B) e } 

can be described explicitly as follows: 
Lemma 5.3. When (/ + m)/2 is even, 
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and when (/ + m)/2 is odd, 

{Vl ® Vm)j-i^ 

= { e = E ^^-«(^'?^ ® - ^'J- ® ^--a) I G C }. 

Next we describe the subgroups of K defined as 

■.={{A,B)eK\ [{ps^p,){A,B)]{a) = a}, 
:={(A5) e K I [(p3 Kpi)(A5)](a) = a 

preserving the orientation of 0} C Ka- 

For {A,B) e K = SU{2) x SU{2), we compute that {A,B) e K\ if and only if {A,B) is one 
of the following elements: 

gv^Si \ /e^^i 
e-^^iJ'V e-^^^ 

where 61 = ^h, 9[ = lk[, h, k[ e Z, h - k[ G 4Z, 

( 

/=Te2 y''Ve^^^ 

where 62 = f ^2, ^2 = f ^2, ^2, ^2 e Z, k2 - k'^ e 4Z, 

where ^1 = f fci, ^2 = f /cs, = ^k[, 9'^ = ^k'^ and k^, k2, k[, k'^ E Z, k^ + k2, ki - ^2, k[ + k'^, 
k[ -k'^e 2Z, ki - k[, k2 - k'^e 4Z, fci + fcs - k'^ - k'^, k^ - k2 - k[ + k'^ E 8Z. 
In particular, the order of is equal to 16 + 16 + 32 + 32 = 96. 

Moreover, for {A, B) e K = SU{2) x SU{2), we have that {A, B) e if and only if (A, B) 
is one of the following elements: 

^V^e, \ fe^''^ 
e-^^J'V e-v^^^ 







1 





















where ^1 = f fci, = f A;;, A;i, k[ e 2Z, A;i - k[ e 4Z, 



_e-v/^eA / -e-v^^2 



16'2 n ' \ ^V^d: 



eV-if^2 



where 62 = jk2, 9'^ = f A;^, k2, k'^ e 2Z, k2 - k'^ e 4Z, 



4 
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where 9i = ffci, 02 = ffca, 9[ = ffc'^, 9'^ = ffc^ and ki,k2,k[,k'^ G 2Z + 1, A;i + k2,ki - k2, 
k[ + k'2, k[ -k'2e 2Z, ki - k[, k2 - k'2 e 4Z, fci + A^s - {k[ + k'2), ki - k2 - {k[ - k'2) E 8Z. In 
other words, {A, B) G K\^a] if and only if (A, B) is one of the following elements: 



-101 











where 6^ = Ui,e[ = f/;, e Z, k - l[ G 2Z, 







-le' 



— e 



-16*2 



-lei 



where ^2 = f/2, ^2 = f^2, ^2,^2 E Z, k - I2 ^ 2Z, 



2 '-2 





1 












V2^ 



-16*2 



/ 1 



V2' 



where ^1 — f /i + f , 6^2 — f/2 + f ) ^'1 — f ^'i + f ; ^2 — f ^2 + f 5 ^i? ^2, ^'i, ^2 ^ Z, /i — l[, I2 — ^2 G 
2Z, h + h — {I'l + ^2))^! — h — {I'l — ^2) ^ 4Z. In particular, the order of i^[a] is equal to 
8 + 8 + 16 + 16 = 48 = 8 X 6 = ^i^o X ttZg. Then we obtain 

Lemma 5.4. K[a]/Ko = Zg. 

Proof. We compute 



V2^ V2^ 

-y2cos(?/i + 5) 











A" 



h 



V2( 
! (m 

if /i = 1 or 2 (mod 4) 



:cos(f/i + f, 

-I2 if Zi = or 3 (mod 4) 



The generator of K[a]/Ko = Zq is represented by the element 



(5.3) 



l +V-l 

2 

l+v^ 



2 



2 



^2 ^ 



□ 



Then using Lemmas 15.21 and 15.31 we can determine directly all eigenvalues of Cl on K/ Kq 
less than or equal to dimL = 6 and corresponding representations of K as in the following 
table: 
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(/, m) 


dim(V/ (g) V,n)K„ 


eigenvalues of Cl 


-A < 6 


(1,1) 


1 


-3 


* 


(2,0) 









(0,2) 









(3,1) 


2 


-3,-3 


* 


(1,3) 


2 


-9,-9 




(4,0) 


2 


-3,-3 


* 


(0,4) 


2 


-15,-15 


* 


(2,2) 


3 


-5, -5, -8 


* 


(5,1) 


3 


-8,-5,-8 


* 


(6,0) 


1 


-6 


* 


(4,2) 


3 


-6,-9,-9 


* 


(3,3) 


4 


-9,-12,-12,-15 




(8,0) 


2 


-10,-10 




(7,1) 


4 


-12,-12,-8,-8 




(6,2) 


5 


-15,-12,-8,-8,-12 





Hence we get 

{{l,m) \-cl<6 and {Vi ® Kn),^^, {0}} 
={(1, 1), (4, 0), (2, 2), (3, 1), (6, 0), (5, 1), (4, 2)}. 



Using the generator 05. 3p of K^oi/Kq = Zg, we compute that (Vi ® Vm)^ = {0} for (/, m) = 
(1,1), (4,0), (3,1), (5,1) and dimc(V^ ® Kn)^?^^, = 1 for (/,m) = (2, 2), (6, 0), (4, 2). But we 
observe that the fixed vector in (V2 ® V2) f^^^^ 7^ {0} corresponds to the larger eigenvalue 8 > 6. 

Hence we obtain that the Gauss image = Gi^^^) = (Z2+Z2'^)-Z6 ^ Q()i^) Hamiltonian 
stable. 

Moreover from the above result of dimension computation we have 

n(L^) = dime V^g K + dime 1^4 KV"2 = 7x1 + 5x3 = 7+ 15 = 22 
=dim50(8) - dim^0(4) = nhk{L). 



Thus the Gauss image = G ( z^^Z2 ^ ~ (72+^^2)- Ze ^ Q&i^) Hamiltonian rigid. From these 
results we conclude 

Theorem 5.1. The Gauss image = G (^4^^^ = (Z2'+Z2)-Zc *^ Qei^) strictly Hamilton- 
ian stable. 



6. The case {U,K) = {S0{5) x SO{5),SO{5)) 

Now {U, K) is of type B2 and U = 50(5) x 50(5), K = {{x,x) e U \ x e 50(5)}. Let u = 
t + p be the canonical decomposition, where u = o(5) © o(5), t = {{X,X) \ X G o(5)} = o(5) 
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and p = {{X, —X) \ X G o(5)}. Let a be a maximal abelian subspace of p given by 



a = < 



/o -6 o\ 

6 

0-^0 
0^00 

\o oy 

t={i7(ei,e2) Ui,6eR}co(5). 



Then the centrahzer Kq oi a in K is given by 










{{I 


B 












which is a maximal torus of S0{5) and = K/Kq = S0{5)/T'^ is a maximal flag manifold of 
dimension n = 8. Moreover K\a] is described as 



% 0' 
J^r„i = I I2 1 ■ U 
1 



1 
-1 



u 



/I 

-1 



V 



1 \ 
1 



7 



rp2 



1 
-1 



rp2 y 



V 



/ 1 \ 

-1 

1 
1 

\ -V 



The deck transformation group of the covering map Q : — )■ Q{N^) is equal to Kioi/Kq = Z4. 



6.1. Description of the Casimir operator. Choose {X,Y)i := — tr(XF) for each X,Y E 
t = so(5). The restricted root system K) of type B2, can be described as follows (cf. [7]): 

S(f/, K) ={±(ei - €2) = ±ai, ±62 = ±a2, ±(ei + €2) = ±(ai + 202), 
± ei = ±{ai + 02)}- 

Then the square length of each 7 G S(f/, K) relative to ( , )t is 



l7ll^ 



1 

- if 7 is short, 
4 

1 



K2 



if 7 is long. 
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In this case K = S0{5) D Ki = 5*0(4) D Kq = T^. The Casimir operator Cl of L" relative 
to the induced metric from 5'q'^(c) becomes 

= iu71i2^^/^o,(,>u - irrT^^Ki/Ko,(,)n 

ll7o||u ll7o||u 

= 4:CK/Ko,{,)n -'^CK^/Ko,{,)n 

= 2 Ck/Ko ~ Cki/Ko 

where Ck/Ko and Cki/Kq denote the Casimir operators of K/Kq and Ki/Kq relative to ( , ){ 
and ( , respectively. 



6.2. Descriptions of D{K) and D{Ki). Since the maximal abelian subalgebra t of t can be 
given by 

6 



we have 



TiK) = T{K^) 

/O -6 
6 



-6 
6 



V 



6,6e27rZ 



> . 



0/ 



Denote by £j (z = 1, 2) a linear function : t 9 t— ?■ .^j G R. Then 

Z)(ir) = 1^(50(5)) = {A = hei + k2e2 \ h, k2 eZ,h>k2> 0}, 
D(i^i) = DiSOiA)) = {A = kie^ + k2e2 \ k^, k2 eZ,k^> \k2\}. 



6.3. Branching law of (50(5), 50(4)). 

Lemma 6.1 (Branching law of (50(5), 50(4)) [2U]). Let A = kiei + k2e2 E D{S0{5)) be the 
highest weight of an irreducible SO{5)-module V\, where ki, k2 E Z and ki> k2 > 0. Then V\ 
contains an irreducible SO (4) -module W\> with the highest weight A' = k[ei + k2e2 G 1^(50(4)), 
where k[, k'2 G Z, /c'^ > l/cg], if and only if 

(6.1) ki > k[ >k2> Ik'^l. 

6.4. Descriptions of D{K, Kq) and D{Ki, Kq). Define an Ad(J^)-invariant inner product of 
t by {X,Y)i := -tr(XF) (X, F G « = o(5)). 

Let {a[ = ei — 62,^2 = ei + ^2} be the fundamental root system of 50(4) and {A'^ = 
|(ei — £2)5^2 = |(ei + €2)} be the fundamental weight system of 50(4). Then 
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(6.3) 



Lemma 6.2 ([50]). 

D{K,,Ko) = D{SO{A),T^) 

= <^ A' = k'^ti + k'2e2 = m\h'^ + m'gAg = Piu'i + P2'^2 | 
(6 2) ^ 

Kez,k[> %lm[ e z,m: > o,p'^ e z,p'^ > i, 

m[ = k[ -k2 = 2p[ > 0, m'2 = k[ + k'^ = ^p^ > o|. 
The eigenvalue formula the Casimir operator Cki/Kq relative to (X, y)t|t^ is 

-CA, = lmr+{k',r+2k[). 

for each A' = k[ei + ^362 E D{Ki, Kq). 

Let {ai = ei — e2,a2 = 62} be the fundamental root system of 5*0(5) and {Ai = ei,A2 = 
1(^1 + £2)} be the fundamental weight system of SO{b). Then 

Lemma 6.3 ([SO]). 

D{K,K^) = D{S0{5),T^) 
= |a = kiei + k2e2 = niiKi + m2A2 = piUi + P2a2 I 

ki E Z, ki > k2 > 0, nii G Z, > 0, Pi E Z, pi > 1, 

mi = 2pi - P2> 0, 7772 = -2pi + 2p2 >0,pi = ki, P2 = ki + k2^ 

The eigenvalue formula of the Casimir operator Ck/Kq with respect to the inner product (X, Y)^ 
is 

-CA = -{kl + kl + 3ki + k2). 
for each A = kiei + k2e2 G D{K, Kq). 

6.5. Eigenvalue computation. By Lemmas 16.31 and 16.21 we have the following eigenvalue 
formula for Cl- 

— Cl = — 2ck/Ko + C-Kr/Ka 

= + kl + 3A;i + k2) - \{{k[f + {k'^f + 2k[). 

Since 

—Cl = —Cr/Ko ~ > —Ck/Ko , 
the eigenvalue of Cl, —cl < n = 8 implies — ca < 8. Using Lemma [Ol we compute 

{AGD(50(5),r2)|-c(A,(, )0<8} 
={ei ((A;i, A;2) = (1, 0)), e, + 62 ((A^i, ^2) = (1, 1)), 2e, {{k,, ^2) = (2, 0)), 
2ei + 62 {{kl, k2) = (2, 1)), 2ei + 2e2 ((A;i, ^2) = (2, 2))}. 

Suppose that {ki,k2) = (1,0). Then dime Va = 5. It follows from Lemma 16.11 that 
{k[,k'2) = (0,0) or (1,0). By Lemma E^l we have {p[,p'2) = (0,0) or (1,|), but A'|(p, .p.)=(o,o), 
A'|(^,^^,)^(.^i) ^D(^0(4),T2). Rence A = {1,0) ^ D{S0{5),T^) = D{K,Ko). 
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Suppose that (/ci,/c2) = (I?!)- Then dimcVA = 10, Va = o(5,C) and K^a]/^^ acts on 
{Vk)ko = (i^)*^ = via the action of Weyl group W{U,K). Thus it must be (\4)i^[„, = {0}. 
Hence, A|(fci,fc2)=(i,i) ^ D{K,K[a]). 

Suppose that {ki.k^) = (2,0). Then (mi, 7712) = (2,0) and dimcV2Ai = 14. It follows 
from Lemma l6.ll that {k'i^k'2) = (0, 0), (1, 0) or (2,0). By Lemma |6.2[ we have (^1,^2) — 
(0,0), (i,|) or (1,1). Note that A'|(p;y,)=(o,o), A'|(,;,py=(i,i) ^ D{S0{4),T'). If {p[,p',) = 
(1, 1), then {m[,m2) = (2,2) and — ca = 5, — ca' = 4, thus 



-cl = -2ca + ca' 
On the other hand, we observe that 

=Symo(C5) 



10-4 = 6 < 8. 



U4 



4 


z 

*Z 



X 




X e Symo(C^ 



Z G M(4,1;C)} 



|A'=0 



2A'^+2A^ 



and 



(^2aJ 



C1/2 



C2/2 



Cl, C2, C3 G C, 2ci + 2c2 + C3 = 



C3> 



As 




C2/2 



C3, 



/o 





1 





o\ 











1 





1 

















-1 











^0 











-V 



we get 



Thus 



(^2aJ 



W] 



CG C 



Wi 



|A'=0- 



W^2a;+2A^, n (V^2aJ 



{0}. 



Suppose that {ki,k2) = (2,1). Then (mi, 7712) = (2,1) and dime V2A1- 



35. It follows 



from LemmaEUthat {k[, k'^) = (1, 0), (1, -1), (1,1), (2, 0), (2, -1) or (2, 1), that is, (m'l, m'2) 
(1, 1), (2, 0), (0, 2), (2, 2), (3, 1) or (1, 3), and thus 



/2A1+A1 = Wa[+A'^ © W2A[ © W'2A^ © W2A[+2A'^ © W^a'^+A'^ © W^A'^+SA^- 

By Lemma ESI we have {p'^p'^) = (i,i), (1,0), (0,1), (1,1), (|, |) or (i,|). Then by 
LemmaOwe see that A'|(p, A'|(p/ ,p/)=(i,o), A'|(p/ )=(o,i), A'|(p, A'|(p, j) 
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^ D{SO{A),T^). If {p[,p'2) = (1, 1), i.e. {m[,m'^) = (2,2), then -ca = 6, -ca' = 4 and thus 

-cl = -2 Ca + Ca/ = 12 - 4 = 8. 

So we need to determine the dimension of (W2A[+2A'2)ki^] {0}. 
Since H^2A'+2A' — 5((2,C) Ks[(2,C) and 

(W^2Ai+2A^)i^o = (5^2, C) K Sl(2, C))ko = C K C, 

we have dimc(Vr2Ai+2Ai,)Ko = 1- Let A^R^o = so(lO) = adp(5o(5)) + V. Then A^C^^ = 
(a2rio)C = so(10,C) = ad(so(5))^ + = 5o(5,C) + V^, where {0} ^ C Vsa^+a,. By 
the irreducibihty of V2A1+A2) "we see V*" = V2A1+A2. Since 

{0} ^ (V^)x(„, = (1^2Ai+2A^)/^H C (1^2Ai+2A^)i^o 

and dimc(lV2A'i+2A^)A-o = 1, we get 

{0} ^ (V^),,,, = (W^2Ai+2A^)i^M = (W^2Ai+2A0i^o 

and dimc(I^2A'j+2Ai,)x[(,] = 1. Hence 2Ai + A2 G D{K, K^^a]) and its multiphcity is equal to 1. 

Suppose that {ki,k2) = (2,2). It follows from Lemma l6.ll that {k[,k2) = (2,0), (2,1), 
(2,2), (2,-1) or (2,-2). By Lemma E21 we have {p[,p',) = (1,1), (i, |), (0,2), (|,i) or 
(2,0) and thus A'|(p, j), A'|(p;,p^)=(o,2), A'|(p, A'|(p'^,p^)=(2,o) ^ 1^(50(4), T^). If 
{Pi^P2) = (1; 1); then — Ca = 8, — ca' = 4 and hence 

-Cl = -2ca + CA' = 16 - 4 = 12 > 8. 

Now we obtain that the Gauss image = Q{S0{5)/T'^) C Qs{C) is Hamiltonian stable. 
Moreover it also follows that 

n(L«) = dimc(y2Ai+Aj = 35 = dim(5O(10)) - dim(50(5)) = n;,fc(L«). 

Hence the Gauss image = Q{S0{5)/T'^) C Qs{C) is Hamiltonian rigid. 
From theses results we conclude that 

Theorem 6.1. The Gauss image = g{S0{5)/T^) = C QsiC) IS strictly Hamiltonian 
stable. 

7. The case {U,K) = (50(10), f/(5)) 

In this case, (f/, K) is of BC2 type and K = f/(5) CU = SO {10). Here each A + ^/^B e 

f/(5) can be identified with an element ^ ^ A ^ ^ 5*0(10) with A,B E 0/(5, R). The 

canonical decomposition u = t + p of u and a be a maximal abelian subspace of p are given by 
u = so(lO), 



{{y x) e5o(10)|-X* = X,F* = F| 

u(5) = {T = X + V^Y G 0[(5, C) I T* = -T} 
X Y 



Y -X 



Gso(lO) I X,y Gso(5) 
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and 



a = < 



Hi 



/O -6 

6 



V 



-6 
6 



6,6 eR 



> . 



0/ 



Then the centrahzer Kn of a in is as follows: 



/ an + + 1612 \ 

-ai2 + i6i2 an - i&ii 

0-22 + 1^22 0-21 + 1^21 

-021 + i&21 022 - i^22 

[\ 033 + i&33 / 



ef/(5) 



= SU{2) X 5f/(2) X f/(l) 
and = K/Kq = U{5)/SU{2) x 5f/(2) x f/(l) is of dimension 18. Moreover, 



K[a] =Ko U 



1 
-1 



V 



1 \ 

1 



V 



/I 



\ 



V 



I 1 \ 

-1 

U 1 -Kq. 
1 

V V 

It means that the deck transformation group of the covering map Q : N ^ Q{N^^) is equal to 

K[a]/Ko — Z4. 



7.1. Description of the Casimir operator. Choose {X,Y)u := — tr(XY) for each X,Y E 
u = 50(10). The restricted root system K) of type BC2 can be given as follows ([7]): 

={±62 = ±ai, ±(ei - 62) = ±«2, ±ei = ±(ai + a2), 

± (ei + €2) = ±(2ai + ^2), ±2ei = ±(2ai + 202), ±2e2 = ±2ai}. 

Then the square length of each 7 G S(f/, i^) relative to ( , )u is 



h\\i=y^oT 1. 
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Hence the Casimir operator Cl of L" with respect to the induced metric from QQ^f^Q^ can be 
expressed as follows: 



Cj 



l7o||u 



C 



K/Ko,{ , >u 



l7o||u 



C 



Ki/Ko,{ , )u 



AC 



K/Ko,{,)u 



-c 



Ki/Ko,{,)u 



2C 



K2/Ko,{,)u 



C 



K/Ko 



+ C 



K/K2 



where Ck/Ko^ ^K2/Ko and Cki/Kq denote the Casimir operator of K/Kq, K2/KQ and Ki/Kq 
relative to ( , )|t, ( , )|{2 and ( , respectively. Here, {X,Y) := — tr(Re(XF)) for all 

x,Y e i = u{5). 

7.2. Descriptions of D{K),D{Ki) and D{K2). Using a maximal abelian subalgebra t of t 
given by 



we have 















o\ 



















2/2 


















< V 


-1 








2/3 







2/1,2/2, 


2/3, 2/4, 2/5 G R- 


> c e, 















2/4 
























y^J 








> 








= r(Ko) 




























o\ 






> 
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= < 






-1 
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1 6,6,6,6,6 G27rZV 











































6^ 






> 



T{C{K)) = 27rZl5. 
Then D{K), D{Ki) and D{K2) are given as follows 
=/^(^(5)) 

={A = piyi H hp52/5 I Pi, 

L>(X2) =I?(t/(4) X U{1)) 

={A = piyi H hP52/5 I Pi, 

D{Ki) =D{U{2) X f/(2) X f/(l)) 

={A = pii/i H hP52/5 I Pi, 



,P5 G Z,pi > P2 > P3 > P4 > Ps}, 
,P5 G Z,pi > P2 > P3 > P4}, 
,P5 G Z,pi > P2,P3 > P4}- 



7.3. Branching laws of (f/(m + 1), f/(m) x f/(l)). 

The branching laws for {SU{m + l),S'(f/(l) x U{m))) was shown by Ikeda and Taniguchi 
|20] . It can be reformulated to the branching laws for {U{m + 1), U{m) x f/(l)) as follows: 



Lemma 7.1 (Branching laws for {U{m + l),f/(m) x f/(l))). Lei A = piyi + ■ ■ ■ + Pmy-m G 
D{U{m)) be the highest weight of an irreducible U{m)-module V\, where pi G Z (z = 1, ■ ■ ■ , m) 
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and pi > P2 > ■ ■ ■ > Pm- Then the irreducible decomposition of Va as a U{m) x U{l)-module 
contains an irreducible U{m)xU{l) -module Va' with the highest weight Va' = (liyi+- ■ ■+(lmym G 
D{U{m) X U{1)), where qi and Q'l > q'2 > ■ ■ ■ > Qm, if (^nd only if 

Pi>qi>P2>q2>p-i>q-i>---> Pm^l > qm.^i > Pm, 

m m 
i=l i=l 

In particluar the multiplicity ofVA> is 1. 

In the next subsection we use the branching laws of {U{m + l),U{m) x U{1)) and 
{U{m), U{2) X U{m — 2)) in the case of m = 4. The branching laws of {U{m), U{2) x U{m — 2)) 
are described in Lemma 19.11 of Section O 

7.4. Descriptions oi D{K,Ko), D{K2,Ko) and D{Ki,Kq). 
Each A G D{K) = D{U{5)) is expressed as 

A = Piyi H 

where Pi € Z, pi > p2 > Ps > P4 > Ps- Then by Lemma [7.11 in the case of m = 4, Va can be 
decomposed into irreducible f/(4) x f/(l)-modules as 

s s 
i=l i=l 

where A^ = qiyi + ^21/2 + gsZ/s + qm + ?52/5 e ^(^2) = D{U{4:) x f/(l)), A'^^ = qiyi + ^2^/2 + 
q3y3 + qm e D{U{A)), q^y^ G I?(f/(1)) and q^ e Z {i = 1,2,3,4,5) satisfy 

Pl>qi>P2>q2>P3>q3>P4>q4.> P5, 
5 5 

i=i j=i 

By the branching law for (f/(4), U{2) x f/(2)) in Lemma [OTTl each VF^, can be decomposed as 

1 i 

where A" = hy, + /C22/2 + hy^ + hy^ G ^(f/(2) x f/(2)). A, = A;iyi + ^2^/2 G ^(f/(2)), 
Ap = ksys + /c4?/4 G D{U{2)) and G Z (i = 1, 2, 3, 4) satisfy 

(i) Eti = Eti 

(ii) gi > /ci > gs, q2 > h > q^] 

(iii) in the finite power series expansion in X of — — X^^Y ' ^^^^ ~ ^' 

are defined by 

ri ■=qi - max(/ci,g2), 

r2 :=min(A;i,g2) - max(A;2, gs), 

rs :=min(fc2,g3) - ^4, 

the coefficient of X^^'^'^^^ does not vanish. Moreover the value of this coefficient is the 
multiplicity of the U{2) x f/(2)-module W'l„. 
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By the branching law of {U{2), SU{2)) (see Section [9]), as 5'[/(2)-modules they become 

wl = wl, wl = wl, 

where A. = ^^^(i/i - ^2) G D{SU{2)), A, = ^^^{ys - y,) G D{SU{2)). 

Hence, one can decompose a /('-module V\ into the following irreducible K^-modvles 

Now assume that A G D{K,Ko). Then there exists at least one nonzero trivial irreducible 
Ko-modu\e in the above decomposition for some a and p. So in this case, we have 



h- k2 = 0, k^- k4 = 0, gs = 0. 



So we know that 



2ki + 2k3 = ^qi = ^Pj, 

i=i j=i 

q2>ki = k2> qs, 
ri = qi- q2, 
r2 = ki - k2 = 0, 
^^3 = ^3 - 

and in the finite power series expansion in X of 

(^ji^'?i-92+i _ Ji^-('?i-g2+i)^('j5^ 93-94+1 _ Ji^-(g3-g4+i)^ 

the coefficient of X does not vanish. Moreover, the value of this coefficient is the multiplicity 
of the U{2) X [/(2)-module. 

Therefore, in the above notations, for each A G D{K, Kq) given by A = piyi +P22/2 +P32/3 + 
PiVi + psys, where pi, ■ ■ ■ ,P5 & 'Z', pi > P2 > Ps > Pi > Ps, each A' G -D(i<'2, i^o) is given by 
A' = qiVi + 92^2 + qsVs + qm, where gi, ■ ■ ■ , ^4 e Z, gi > > ^3 > ^4, ELiP* = Ej=i ^j- 
Moreover, each A" G D{Ki, Kq) is given by A" = kiyi + k2y2 + k^yz + k4Xii, where fci, • ■ ■ , /C4 G Z, 
^1=^2,^3 = ^4, 2/i;i + 2^3 = Xl^^i ^i- 

7.5. Eigenvalue computation. For each A = piyi + P2Z/2 + P^yz + P4I/4 + PsZ/s G /^(K, Kq), 
with Pi & Z, pi > p2 > P3 > P4, > P5, the eigenvalue formula of the Casimir operator Ck/Kq 
with respect to the inner product {X, Y)^ = — Tr(Re(XY)) for any X,Y & i = u(5) is given by 

-ca =pI+pI+pI+pI + pI + 4pi + 2p2 - 2p4 - 4^5. 

For each A' = qiyi + ^2^/2 + qsVs + qm G D{K2, Kq) with G Z and qi > q2 > qs > g4, the 
eigenvalue formula of the Casimir operator Ck^/Kq with respect to the inner product ( , is 
given by 

-CA' =ql + ql + ql + ql + 3gi + g2 - g3 - 3g4. 
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For each A" = A;i?/i + fc2|/2 + fc3l/3 + ^4y4 £ D{Ki, Kq) with ki = k2 and ks = k^^, the eigenvalue 
formula of the Casimir operator Cki/Ko with respect to the inner product ( , ){|{^ is given by 

-ca" =kl + kl + kl + kj + ki - k2 + ks - k4 

— k^ -\- ^2 ~l~ ^3 ~l~ ^4- 

Hence, we have the following eigenvalue formula 

1 



-cl 



(7.1) 



-2CA 

2(P? + 



CA' 



,2 I ^2 



(9? + ?2 + + ?4 + 3gi + q2 
-{kl + k^ + kl + kl). 



2p2 - 2p4 

- q-i - 3^4) 



4P5 



By using and estimating the formula from above by 18, we get that 

Lemma 7.2. A = piyi + ^2^/2 + PsUs + PiVi + P5y5 € D{K) belongs to A G D{K,Kq) with 
eigenvalue —cl < 18 if and only if {pi,P2,P3,P4:,P5) is one of 

(0,-1,-1,-1,-1), (1,1,1,1,0), (1,1,0,0,0), (0,0,0, 



-1,-1,-1,-1; 
;i, 0,0, 0,-1), (2,1,1,0,0), (0,0, 



:i,i,o. 



Denote by wi, a;2, ^3, ^4 the fundamental weight system of SU{5). 

Suppose that A = (1, 1, 1, 1, 0). Then dim Va = 5. By the branching law of {U{5), U{4) x 
[/(I)), A' = (1,1, 1, 1, 0) or (1, 1, 1, 0, 1), where A' = (1, 1, 1, 1, 0) e D{K2, Kq). By the branch- 
ing law of (t/(4),f/(2) X U{2)), A" = (1,1,1,1) G D{Ki,Kq). Thus -ca = 8, -ca' = 4, 
— ca" = 4 and —cl = — 2ca + ca' + |ca" = 10 < 18. 

On the other hand, A = Aq + W4, where Aq = f XlLi "^^^ group K = f/(5) = 
C(f/(5)) ■ SU{5) acts on dimVA = 5 and Va = C (g) by pAo ^ A^s, where /is denotes the 
conjugate representation of the standard representation of SU{5) on C^. For each element 
A 

G Kq and each element m ® w G C ® C^, where A,Be SU{2) and 




B 



Pa(5'o)(m® w) =pAo(e 




5'ojw 



Hence {Va)ko = spanc{l 



/0\ 





VI/ 
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For a generator g 



e A'rd C K2 in Z4, 



/ 1 \ 

1 

1 
-1 

V 1/ 

So (V^A)i^M = {0}, i.e., A = (1,1,1,1,0) ^ Similarly, we get A = 

(0,-1,-1,-1,-1) 

Suppose that A = (1,1,0,0,0). Then dimVA = 10. By the branching law of 
(t/(5), t/(4) X f/(l)). A' = (1, 1, 0, 0, 0) or (1, 0, 0, 0, 1), where A' = (1, 1, 0, 0, 0) G DiK^, Kq). 
By the branching law of (t/(4), U{2) x U{2)), A" = (1, 1, 0, 0), (0, 0, 1, 1) or (1, 0, 1, 0), where 
A" = (1,1,0,0) or (0,0, 1,1) G D{Ki,Ko). Thus -ca = 8, -ca' = 6, -ca" = 2 and 
-cl = -2ca + ca' + |ca" = 9 < 18. 

On the other hand, A = Aq + 002, where Aq = fELi?/*- Va = C © A^C^ Let 
{61,62,63,64,65} be the standard basis of C^. For each element Qq G Kq expressed as above 
and each element -u ® 6j A 6^ G Va (1 < < j < 5), 

pAi9o){u ® 6i A Bj) = pAo(e'^^/5)(M) ® Pu;2 (e"'^^) (e* A 6j) 
= e^t^n (g) {e-'^^Qoei A e-'^%6j). 

It follows from this that (y\)Ko = span(-.{l © (ei A62), 1®(63 A64)}. For the generator g G Kia] 
of Z4 given above, we have 

PA(fi')(l ® ei A 62) = -10 63 A 64, 
Pa(5')(1 ® 63 A 64) = 10 61 A 62. 

Hence (Va)k[„, = {0}, i.e., A = (1,1,0,0,0) ^ D{K,K[^]). Similarly, we get A = 
(0,0,0,-1,-1) ^Z}(A^i^[„]). 

Suppose that A = (1,0,0,0,-1). Then dimVA = 24. By the branching law of 
([/(5),[/(4) X f/(l)). A' = (1,0,0,0,-1), (1,0,0,-1,0), (0,0,0,0,0) or (0,0,0,-1,1), where 
a; = (1,0,0,-1,0), A'2 = (0,0,0,0,0) G D{K2,Ko). By the branching law of (t/(4),f/(2) x 
f/(2)). A'/ = (1,0,0,-1), (1,-1,0,0), (0,0,0,0), (0,0,1,-1) or (0,-1,1,0), where A'/ = 
(0,0,0,0) G D{Ki,Ko). Also, A'^ = (0,0,0,0) G D{Ki,Kq). Thus -ca = 10, -ca'^ = 8, 
-ca'/ = 0, -cl = -2ca + ca' + |ca" = 12 < 18 and -ca^ = 0, -ca^' = 0, -c^ = 20 > 18. 

On the other hand, A = wi + a;4 corresponds to the adjoint representation of SU{5). 



V^A = c ® (C 




^(0,0,0,0,0) ® ^(1,0,0,-1,0) ® ^(1,0,0,0,-1) ® ^(0,0,0,-1,1)- 
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{Va)kq = { I C2/2 I I ci, C2, C3 G C, 2ci + 2c2 + C3 = 

•^^(0,0,0,0,0) ® ^(1,0,0,-1,0)- 

By direct calculations, we get that for a generator g G A'[„] C -ft'2 in Z4 as above, 

/C1J2 
Ad(^) C2/2 

v % 

Hence, 

(^aKi = {("^^' ,) |cgc|=\/('o,o,o,o,o)- 

But this 1-dimensional fixed vector space corresponds to the larger eigenvalue 20. 

Suppose that A = (2, 1, 1, 0, 0). Then dim Va = 45. By the branching law of (t/(5), t/(4) x 
[/(I)) that Va can be decomposed into the following irreducible K2 = U{4:) x ?7(l)-submodules: 

Va = ^(2,1,1,0,0) ® ^(1,1,1,0,1) ® ^(2,1,0,0,1) ® ^(1,1,0,0,2)5 

where A' = (2,1,1,0,0) G D{K2,Kq). By the branching law of (f/(4),f/(2) x f/(2)). A" = 
(2, 1, 1, 0), (2, 0, 1, 1), (1, 1, 2, 0), (1, 1,1,1) or (1, 0, 2, 1), where A" = (1, 1, 1, 1) G Z^(A'i, K^). 
Thus — ca = 16, — ca' = 12, — ca" = 4, — = — 2ca + ca' + |ca" = 18. 

On the other hand, since V^-^ 1 1 1) ® ^(2 1 1) ® ^(1 1002) nonzero vectors fixed by Kq^ 

we see that (Va);^,) C Vl^^^^^^^ ^y Note that A' = 2yi + y2 + y3 = X;?=i Vi + Vi-yA^ D{K2, Kq) 

corresponds to the tensor product of C{U{A)) representation with the highest weight 

the adjoint representation of SU (4) with the highest weight yi—yi and the trivial representation 

of [/(I). Then for each element Qq G Kq and each element u®X®v&C® su(4) ® C = Va', 

Pa'(^o)(^^®^®^) = Ad 1^ ^^{X)®v. 
Thus (VA)_ft:o = span{l ® (^^'^ ^ ^ ® 1}. For the element g G C -ft'2, 

pA>{g){u O 1^ ^ ® i;) = e^^n ® ® ^' 

It follows that (l^A)i^[„j = (V^A)ifo> i-e-, A = (2, 1, 1, 0, 0) G D{K, K[^) with multiphcity 1. Sim- 
ilarly, A = (0, 0,-1,-1, —2) G D{K, K[a]) with multiplicity 1 and it also gives the eigenvalue 
18. 

Suppose that A = (1,1,0,-1,-1). Then dim Va = 75. By the branching law of ([/(4), ?7(2) x 
U{2)), Va can be decomposed the following irreducible Ki = ?7(4) x f/(l)-submodules: 

Va = V(i^]^^o,-i,-i) ® ^(1,1,-1,-1,0) ® ^(1,0,0,-1,0) ® ^(1,0,-1,-1,1)' 

where A; = (1,1,-1,-1,0) and A'2 = (1,0,0,-1,0) G D{K2,Ko). For A'2, by the branch- 
ing law of (t/(4),[/(2) X f/(2)), A'^ = (1,0,0,-1), (1,-1,0,0), (0,0,-1,-1), (0,0,0,0) or 
(0,-1,1,0), where A'^ = (0,0,0,0) G D{Ki,Ko). Therefore, -ca = 16, -ca'^ = 8, -ca'^' = 0, 
and -cl = -2ca + ca^ + ^ca'^' = 24 > 18. For A^, by the branching law of (f/(4), f/(2) x f/(2)), 
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A" =(1,1,-1, -1), (1, 0, 0, -1), (1, -1, 1, -1), (0, 0, 0, 0), (0, -1, 1, 0) or (-1, -1, 1, 1), where 
A'/i = (1,1,-1,-1), A'/2 = (-1,-1,1,1), A'/3 = (0,0,0,0) e D{K^,Ko). Thus -ca = 16, 
-ca' = 12, -ca'/^ = -ca'/j = 4, -ca'/3 = 0, -cl = -2ca + ca' + |ca" = 18, 18 or 20. Moreover, 
from the above irreducible /r2-decomposition of V\ and eigenvalue calculations, we only need 
to determine dim(VA)ft:j^j fl {V([ © V/2) since the fixed vectors in this subspace by K[a] give the 
eigenvalue 18. Here we set V([ := V^'„ and ¥('2 := V^'^^. 

Recall that the irreducible representation of SU{4) with the highest weight A'^^ = Vi + y2 — 
Us ~ Hi = "2^2 can be described as follows ([TS]): 

where /(Gr2(C^))2, the ideal of the Grassmannian Gr2{C^), denotes the space of all homo- 
geneous polynomials of degree 2 on P(A^C^*) that vanish on Gr2(C'^). Here I{Gr2{C^))2 — 
A^C^ = C can be written down explicitly in terms of a basis {ei, 62, 63, 64} of C^: 

/(Gr2(C^))2 = span{(ei A 62) ■ (eg A 64) + (ei A 64) ■ (62 A eg) 
-(eiAe3)-(e2Ae4)}. 

Thus a basis for V^, can be given explicitly. For any element G Kq, denote = ^ G 
SU (2) X SU (2) C f/(4). The representation of Kq on any element m (g) X (g) w; G C (g) V^, © C is 

PA{g){u ^X^w) = Po(l)(«) ® PA',{9o){X) ® po(e^^)(w). 

By direct computations, we obtain 

{Va)ko n V^/ = spanc{ 1 ® (ei A 62) ■ (ei A 62) ® 1, 

1 (g) (eg A 64) ■ (eg A e4) O 1, 
1 (g) (ei A 62) ■ (eg A e4) (g 1}, 

where (ei A e2) ■ (ei A 62) G (eg A e4) ■ (eg A e4) G ¥{'2 and (ei A e2) ■ (eg A e4) G V/g. 

/ 1 \ 

1 



For the generator g G K[a] C K2, denote g' 

■u (g X (g w is 



. The representation of g on 



V -1 / 



Pa(^)(m ® X ® w) = Po(e'^''/4)(n) ® pAi(e- VV)(^) ® Po(l)(w^)- 
It follows that 

(Va)/<[„j n V;(, = spancll (g (ei A e2) ■ (eg A e4) (g 1, 

1 (g (ei A e2) ■ (ei A e2) (g 1 - 1 (g (eg A e4) ■ (eg A e4) (g 1}. 

In particular, A = (1, 1, 0, —1, — 1) G D{K, K[a]) and 

{Va)k,^, n {Vl[ © v;'2) 

= spandl (g (ei A e2) ■ (ei A e2) © 1 — 1 © (eg A e4) ■ (eg A e4) © 1} 
with dimension 1, which corresponds to the eigenvalue 18. 
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Now we obtain that the Gauss image L^^ is Hamiltonian stable. Moreover, 

n{L^^) =dim V(o,o-i,-i -2) + dim V(2,i,i,o,o) + dim V"(i,i,o -i _i) 

=45 + 45 + 75 = 165 = dim ^0(20) - dim U{5) = n^kiL^^)- 

Hence the Gauss image L^^ is Hamiltonian rigid. 

Therefore, we conclude that the Gauss image L^^ is Hamiltonian stable. 

Theorem 7.1. The Gauss image L^^ = Q (^ (g^(2)x5if(2)x[/(i)) ) ^ 
{su{2)xSij'^^)xU(i))-Z4, Qi&{^) ^■^ strictly Hamiltonian stable. 

8. The case (t/, K) = {SO{m + 2), 50(2) x SO{m)) (m > 3) 

In this case {U, K) is of type B2. The canonical decomposition u = t + pofu = o(m + 2) 
and a maximal abelian subspace a of p are given as 

e={(^' T,) l^ieo(2),T2Go(m)} = o(2) + o(m), 
P = {(x ~0^) l^eM(m,2;R)}, 



Then 



Moreover 

consists of all elements 



where 

(A 5) 



{(1)' t) I^e50(m-2)| 
^Zs X 50(m-2). 

^ (Z2 X 50(m - 2)) ■ Z4 

'AO 0\ 

5 G A' = S0(2) X SO{m) 
5'/ 



1 0\ A 0\\ //-I \ A 

ij ' ijy) ' -i) \q I 

1 o\ }-i o\\ //-I oW-1 
ly'Vo -v/'vvO -ly ' V -i 

-iWo //o iWo -] 

1 y ' Oy/'^-l 
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Here note that K]^^] ^ Ki = 5*0(2) x 5*0(2) x 5'0(m — 2). Thus the deck transformation group 
of the covering map G : N^"^-^ g{N^"'-^) is equal to K^^^/Kq ^ Z4. 

8.1. Description of the Casimir operator. Denote (X, F)u := — |trXF for each X,Y E 
u = o(m + 2). The restricted root system S(t/, K) of type can be given as follows ([7]): 

S+(f/, K) = {ei - 62 = ai, £2 = "2, El + 62 = ai + 2^2, Si = ai + 02}. 

Then, relative to the above inner product ( , )u, the square length of any restrict root 7 G 
Tj{U,K) is ||7||u = 1 or 2. Hence the Casimir operator Cl of L with respect to the induced 
metric from Q2m-2{C) is given as follows: 

(^gl-^ ll7o|lu ll7o|lu 

= Ck/Kq - 2 ^Ki/Ko, 

where = ^0(2) x SO{m) D A'l = 50(2) x 50(2) x SO{m - 2) D Kq = Z2 x SO{m - 2) 
and Ck/Kq, Cki/Ko denote the Casimir operators of K/Kq and Ki/Kq relative to ( , )u|{ and 
( , )u|ti, respectively. 

8.2. Branching laws for (SO{n + 2), 5*0(2) x 5*0(72)). We need the branching laws for 
(50(n + 2),50(2) X SO{n)) by Tsukamoto ([17]). 

Lemma 8.1 (Branching laws for (50(2p + 2), 50(2) x S0{2p)),p> 1). Let A = hoeo + hiei + 
■ ■ ■ + hp^iEp^i + ehpEp G D{S0{2p + 2)), where e = \ or —1 and Hq, hi, - ■ ■ ,hp are integers 
satisfying 

(8.2) ho>hi>--->hp>0 

and A' = koEo + kiEi H h kp^iEp-i + e'kpEp G D{S0{2) x 5*0(2^)), where e' = 1 or —1 and 

ko,ki, - ■ ■ ,kp are integers satisfying 

(8.3) A;i > ■ ■ ■ > A;p > 0. 

The irreducible decomposition of as a 5*0(2) x SO {2p) -module contains an irreducible 
5*0(2) X S0{2p) -module V^, if and only if 

hi-i >ki> hi+i (1 < i < p - 1), 
hp-i >kp>0, 

and the coefficient of in the finite power series 

P-l Vli+l v-k-l 

does noi vanish, where 



lo 

.4) /. 

liri 



ho — maxj/ii, A;i}, 

min{/ii, ki} - max{/ij+i, /ci+i} (1 < i < p - 1), 
min{hp, kp}. 

Moreover, the coefficient of X'^" is equal to the multiplicity of VJ^, appearing in the irreducible 
decomposition. 
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Lemma 8.2 (Branching laws for {S0{2p + 3), S0{2) x S0{2p + > 1). Let A = HqEq + 
hiEi + ■ ■ ■ + hp-iEp-i + hpSp G D{S0{2p + ?))) , where Hq, hi, - ■ ■ ,hp are integers satisfying fl8.2p 
and A' = koeo + kiEi + ■ ■ ■ + kp-iep-i + kpep G D{S0{2) x S0{2p + 1)), where ko,ki, - ■ ■ ,kp are 
integers satisfying (18.31) . The irreducible decomposition ofV\ as a S0{2) x S0{2p + 1) -module 
contains an irreducible 5*0(2) x S0{2p+ l)-module VJ(, if and only if 

hi-i > ki> hi+i, {1 <i <p-l) 
hp^i > kp> 0, 

and the coefficient of in the finite power series 

}\ J 

does not vanish, where integers loJi, ■ ■ ■ ,lp are defined by (18. 4p . Moreover, the coefficient of 
X^° is equal to the multiplicity of Vj^, appearing in the irreducible decomposition. 

8.3. Description of D{K,Kq) and eigenvalue computations. 

For m = 2p {p> 2) OT m = 2p+l {p > 1), each A G D{K) = D{S0{2) x SO{m)) can be 
expressed as 

A = koEQ + kiSi H h kpSp, 

where k^SQ G D{S0{2)), A := kiEi + ■ ■ ■ + kpSp G D{SO{m)) and /cq, /ci, ■ ■ ■ , fcp G Z satisfying 

^1 > ^2 > ■ ■ ■ ^ kp-i ^ l^pl if m = 2p, 

ki > k2 > ■ ■ ■ > kp^i > kp> if m = 2j> + 1. 

Then we have 
Note that 

^(/s:, Ko) = D{S0{2) X 50(m), Z2 x SO{m - 2)) 

C D(50(2) X SO{m), SO{m - 2)), 

D{Ki,Ko) = D{S0{2) X 50(2) x SO{m - 2), Z2 x 50(m - 2)) 

C D{S0{2) X 50(2) X SO{m - 2), 50(m - 2)). 

By applying Lemmas EH and EM to both cases (50(2p), 50(2) x S0{2p - 2)) and 
{S0{2p), SO (2) X S0{2p - 1)), we can describe D{K, Kq) as follows: 

Lemma 8.3. Assume that p > 2. Let A G D{K). Then an irreducible K -module Vj^ with the 
highest weight A contains an irreducible Ki-module V^, with the highest weight A! G D[Ki) 
satisfying (V^Jkq 7^ {0} if and only if 

A = koEo + kiEi + k2e2 G D{K), 
A' = koEo + k[6i G D{Ki), 
where kQ, ki, k2, k[ G Z, A;i > A;2 > satisfy the following conditions: 

(i) The coefficient of X^^ in the finite Laurent series expansion — — 'j^zii of 

X does not vanish. 

(ii) /cq + k'^ is even. 
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In particular —{ki — ^2) < < (^i — ^2)- Here the coefficient is equal to the multiplicity of 

8.3.1. The case m = 2p {p>2). 

Suppose that m = 2p (p > 2). For each 

A = koEo + kiEi + e D{K, Kq) = D{S0{2) x S0{2p), x S0{2p - 2)) 

with A' = koEo + k[ei G D{Ki, Kq) = D{S0{2) x 50(2) x S0{2p - 2), Z2 x S0{2p - 2)) as in 
Lemma [575| —Ck/Kq and —Cki/Kq have eigenvalues 

-cji^ = kl + kl + kl + 2{p - \)kx + 2(p - 2)A;2, 

— c^/ = 2(^0 + ^ i)- 

Hence by the formula fl8.ll) the corresponding eigenvalue of — is 

1 



„2 , .2 , 7 2 



1 



Ui^Ui^Hi^ 2{p - l)fci + 2{p - 2)k2 -^ikl + k'l). 



Denote A = /co^o + ^1^1 + ^2£^2 ^ Kq) by A = (/cq, /i;2) 

For each A = koSo = {ko, 0, 0) G D{K, Kq), as /c'^ = 0, /cq = /co + k'l is even and — cl = ^k^, 
we see that 

(8.6) - Cl < 2m - 2 = 4p - 2 if and only if k^ < 4(2p - 1). 

/O 1 \ 

-1 

As = Ukoeo ® C = f/fco£o' fo^^ a generator 51 



1 

1 



\ 



r 



G K^^a] which will be used 



throughout this section, we have 

Pfeoeo(^7)(^'®l) = e^^'■"(^®l)• 
Hence 

(8.7) {ko, 0, 0) G D{K, K[^i) if and only if ko G 4Z. 

(i) The case g{N') = ^fj^^omi ^ ^^(C) with p = 2. 

Since -c^ = -^ck/Ko - \ck/Ki > -Ick/Kq, note that -cl > 6 implies -c-^ = -ck/Kq < 12. 
Using the eigenvalue formula (18. 5 p we compute that 

Lemma 8.4. A = koSo + /ci^i + k2e2 G D{K,Ko) has eigenvalue —c^ < 6 if and only if 
{ko, ki, ^2) is one of 

{0, (±2, 0, 0), (±1, 1, 0), (0, 1, 1), (±2, 1, 1), (0, 2, 0), (0, 1,-1), (±2, 1, -1)}. 

Suppose that A = (±2, 0, 0). Then by (jpD A = (±2, 0, 0) ^ D{K, i^[„]). 
Suppose that A = (±1, 1, 0). Then dimV^ = 4 and = Ukoeo ® C^, where A = ei e D{K) 
corresponds to the matrix multiplication of 5*0(4) on C^. It follows from the branching law 
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(LemmaEH p=2) of (50(4), S0{2) x S0{2)) that k[ = ±1. Hence -cl = ^k^ + |. Note that 
Ukoeo ® can be decomposed into irreducible 5*0(2) x 5*0(2) x 50 (2)-modules as 

Uk,eo ® = (Ukoeo ® (C' © {0})) © {Uk,eo ® ({0} © C^)). 

There is no nonzero fixed vector by Z2 x 50(2) in Ukoeo ® ({0} ® C^)- Moreover, since 



PfcoeoH 



■ei 



(V (g) 



T, 



W2 





-Itt/co 



V © 



-W2 





gV^7r(feo + l)^ ® 



U'2 





V / Vo/ 

it follows that (V;v)ifo = (^a)z2xso(2) 7^ {0} if and only if ko is odd, and then (V;v)z2x50(2) 
Ukoeo © (C^ © {0}). Let ko be odd. However since 



pkoeo+e^ig)iv ® 



7 ) = eV-TfH© 

f^fcoeo ® ® {0}) nonzero fixed vector by (Z2 x 5*0(2)) ■ Z4, and hence (fco, 1,0) ^ 

D{K,Ki„]). In particular (±1,1,0) ^^D{K,Ky^{). 

Suppose that Ai = (/cq, 1, 1) and A2 = (/co, 1, ~1)- Then dimy^^ = dim V^^ = 3 and Vj^^ © 



V-^^ ^ C© A^C^ It follows from the branching law (LemmaEH p=2) (50(4), 50(2) x 50(2)) 
that 

^Ai = ^{kQ,l,l) ® ^(fco -1 -1) ® Kfco,0,0)) 

where (^0,0,0) G D{Ki, Kq). Thus —cl = ^kQ + 4, which is equals to 4 when ko = and 6 
when ko = ±2. 

Let {ci, 62, 63, 64} be the standard basis of C^. Then we have 

V^^ = span{ei A 62, ei A 63 - 62 A 64, ei A 64 + 62 A 63}, 

= span{e3 A 64, ei A 63 + 62 A 64, Ci A 64 - 62 A 63}. 

Since ei A 62 G A^C"^ is fixed by the representation of 5*0(2) x 50(2) with respect to the 
highest weight Ai, 

(^aJa-o = span{l © (ei A 62)}. 

Moreover, 

pA,i9){v © (ei A 62)) = e^^fco^, ^ A d). 

Hence, Ai = (0, 1, 1) ^ D{K,K[,]) but Ai = (±2, 1, 1) G /^(i^,^^) and (V^aJ/^w = C©C{eiA 
62} for /co = 2 or —2, both of which give eigenvalue 6. Similarly, A2 = (0, 1,-1) ^ D{K, K^^]) 
but A2 = (±2, 1, -1) G D{K, Ki^i) and (V^Ja'^ = C © C{e3 A 64} for A;o = 2 or -2, both of 
which give eigenvalue 6. 
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Suppose that A = (0, 2, 0). Then dim V^;^ = 9 and = C®So(C^), where the corresponding 
representation of 50(4) is just the adjoint representation on So(C^). It follows from the 
branching law of (50(4), 50(2) x 50(2)) that k[ = 0, ±2. Thus -cl = 8 - \k[^ . When 
k[ = ±2, —Cl = 6, otherwise —cl = 8 > 6. On the other hand, Sq(C^) can be decomposed 
into the following 50(2) x 50 (2)-modules: 

V^e, = S2(C^) = SliC^) © S^(C2) © M(2, 2; C) © C ' 



Thus, Sg(C2) © C C is fixed by {-h} x 50(2) and dim{V^)Ko = 3. Moreover, 

Pa(^)(^® 







(-a b \ 


—a 


\) = v® 


b a 


0) 




\ 0/ 



-I, 



Hence, 




Notice that the first summand lies in the 50(2) x 50(2) x 50(2)-module © V!_2ei, which 
gives eigenvalue 6 and the second summand lies in the 50(2) x 50(2) x 50 (2)-module with 
respect to weight (0, 0, 0) G D{Ki, Kq), which gives eigenvalue 8 > 6. Therefore, A = (0, 2, 0) G 
D{K,K[a]) £^nd the multiplicity corresponding to eigenvalue 6 is 1. 

Now we know that ^(A^^) C Qg{C) is Hamiltonian stable. Since A = (2,1,1), (—2,1,1), 
(2, 1, —1), (—2, 1, —1), (0, 2, 0) G D{K, Ki^a]) give the smallest eigenvalue 6 with multiplicity 1 
and 

n(L6) 

= dim V(2,i,i) + dim ^^(-2,1,1) + dim ^^(2,1,-1) + dim V'(_2,i _i) + dim 1^(0,2,0) 
=3 + 3 + 3 + 3 + 9 = 21 = dim 50(8) - dim(50(2) x 50(4)) = nhk{L^). 
Hence we obtain that ^(A^^) C Qq{C) is strictly Hamiltonian stable, 
(ii) The case g{N'P-') = (^Sog-g^k ^ ^4^-2(0) with p>3. 

Suppose that A = (A;o,0,0) and fco G 4Z \ {0}. Then k[ = and by ([HI]) A G D{K,K[a]). 
As p > 3, we have 16 < 20 < 4(2p - 1). Hence by ( 18T|) we see that for every /cq G 4Z \ {0} 
such that 16 < kl < 4(2p- 1) we have eigenvalue -cl = l^o < 4p-2. Therefore, Q{N'^P''^) = 

(Z2x50(2p^9^>Z4 ~^ Qip-2iC) is not Hamiltonian stable if p > 3. 
Theorem 8.1. 

^4p-2 _ ^^^(2) X 50(2p))/(Z2 X 50(2p - 2))Z4 (p > 2) 

is not Hamiltonian stable if and only if [m — 2) — 1 = 2p — 3 > 3. If p = 2, then it is strictly 
Hamiltonian stable. 



Remark. The index z(L^^ ^) goes to 00 as p — )■ 00. 
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8.3.2. The case m = 2p + 1 {p>l). 

Assume that m = 2p + 1 (p > 2). For each 

A = koEo + he, + k2e2 e D{K, Ko) = D{S0{2) x S0{2p + 1), Z2 x S0{2p - 1)) 

with A' = k^eo + k[ei G D{Ki, Kq) = D{S0{2) x ^0(2) x S0{2p - 1), Z2 x S0{2p - 1)) as in 
Lemma [575| —Ck/Kq ^"^^ ~Cki/Ko have eigenvalues 

~Cj;^ = kl + kl + kj + {2p - l)k, + {2p - 3)k2, 

Hence by the formula (18.11) the corresponding eigenvalue of —Cl is 

1 

(8.8) 2 ^ 

= kl + kl + kl + {2p - l)fci + {2p - 3)k2 - -{kl + k'l). 

Denote A = /co^o + ^1^1 + ^282 G D{K, Kq) by A = (/cq, ^i, ^2)- 

For each A = /cq^o = (^O) 0, 0) e -D(-R', -R'o)) as k[ = 0, ko = ko + k[ is even and —cl = ^k^, 
we see that 

(8.9) - Cl < 2m - 2 = 4p if and only if k^ < 8p. 

As Vj^ = Uk,eo ® C = Uk,eo, we have 

Hence 

(8.10) {ko, 0, 0) e D{K, Ki^i) if and only if ko E 4Z. 
(i) The case g{N^) ^ ^ Q4(C) with p = 1. 

In this case /sT = ^0(2) x 30(3), Ki = SO (2) x ^0(2) and Ko = Z2, where Z2 is generated 
by ~Q ^ J ^ G f/ = 50(5). Let I4 be an irreducible 50(2) x 50(3)-module with the highest 

weight A = koEo + kiSi G D{K) = D{S0{2) x 50(3)), where ko, k^EZ and ki > 0. It follows 
from the branching law of (50(3), 50(2)) that contains an irreducible 50(2) x 50(2)- 
module V^, with the highest weight A' = koEo + k[ei G D{Ki) = D{S0{2) x 50(2)), where 
k[ G Z, if and only if \k[\ < k,. Then we see that A' G D{S0{2) x 50(2), Z2) if and only 
if ko + k[ is even. By the formula (18. ip the corresponding eigenvalue of the Casimir operator 
-Cl is 

(8.11) -CL = kl + kl + ki- ^{kl + k'l) = hi + kl + kl - hi'l . 

Denote A = koEo + kiSi G D{S0{2) x 50(3), Z2) by A = {ko,ki). Using the eigenvalue 
formula 18.111 we compute that A = fco^o + kiSi G D{K,Ko) has eigenvalue —cl < 4 if and 
only if {ko,ki) is one of 



{(±2,0), (±2, 1), (±1,1), (0,1), (0,2) }. 
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Suppose that A = (±2, 0). Notice that for any f ® w G Vkgeo — C ® C, 

A = ^0^0 G D{K, K[a]) if and only if ko e 4Z. Hence A = (±2, 0) D{K, 

Suppose that A = {ko, 1). Then dim = 3. The complex representation of = 5*0(2) x 
50(3) with the highest weight A corresponds to 

h = Uk^eo ® Ve, = Uk,eo ® = (f/,„,„ ® C^) © (f/fe„,„ © C^). 

For each v <^ w E Uk^eo ® ^^'^ diag(— /2, —I2, 1) G f^o, where w = (^1,^2,^2)* ^ C^, the 
representation of Kq is given by 

p^(diag(-/2,-/2,l))(i;©w) = e^*^°"t;© (-w;i,-W2,W3)*. 

Then (V"^)^^^ = C© €(0,0,^3)* ^ C©Cif A;ois even and (V"^)^^^ = C©C(wi, ^2, 0)* ^ C®C^ 
if ko is odd. Moreover, 




Thus A G -D(-ft', -/^[a]) if and only if ko = 2mod4 and its multiplicity is 1. In particular, 
A = (0, 1) or (±1, 1) ^ D{K,K[^'i) and A = (±2, 1) G D{K,K[^-i). For A = (±2, 1), it follows 
from the branching laws of (5*0(3), 50(2)) that \k[\ < ki thus k[ = such that kQ + k[ is even. 
Hence, —cl = 4. 

Suppose that A = (0,2). Then dime VJ\^ = 5. It follows from the branching law of 
(50(3), 50(2)) that k[ = or ±2. If k[ = ±2, then -cl = 4. If k[ = 0, then -cl = Q > 4. 
On the other hand, A = 2ei G D(50(3)) corresponds to V\ = Sq(C'^) and the representa- 
tion of 50(3) on Sq(C'^) is just the complexified isotropy representation of a symmetric pair 
(5[/(3),50(3)). Thus So(C^) can be decomposed into irreducible 50(2)-modules as 




a^. . 
So(C')©<| |0 6 I |a,6GCl©C'^ 
a b 0, 



-2 




vL, © vUs, © © © n'- 



-2 



Using this expression we can directly show that (V^)xo = (C © So(C )) © (C © C 

and (\/^)^,„j ^ C © C © (C © C (^^' Hence A = (0,2) G DiK,K[,^) 

with multiplicity 2. Note that the first summand of (V^)^^[(,] ^^^^ in C © (Vg^^ © V^2ei)^ which 
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gives eigenvalue 4 with multiplicity 1 and the second summand of {V^^Jk^^^ lies in C® VJ^', which 
gives eigenvalue 6(> 4) with multiplicity 1. 

Now we obtain that ^(A^^) C Q^iC) is Hamiltonian stable. Moreover since 

n{L'^) = dim V(2,i) + dim V(-2,i) + dim V(o,2) = 3 + 3 + 5 

= 11 = dim 50(6) - dim(50(2) x S0{3)) = nhk{L^), 



50(2)x50(5^)^ _^^^(^^ Withp = 2 

D{S0{2) X 50(5), Z2 X 50(3)) by A 



= Q{N^) C QaIC) is Hamiltonian rigid. Therefore ^(A^^) C (54(C) is strictly Hamiltonian 
stable. 

(ii) The case g{N^) - (z,x50(3)). 

Denote A = koEo + kiEi + A;2£2 € D{K,Kq) 
{ko, ki, k2). Let A' = koSo + k'-^ei G D(Ki, Kq) = D{S0{2) x 50(2) x 50(3), Z2 x 50(3)) as 
in Lemma 18.31 Then using the eigenvalue formula (18. 8p we compute 

Lemma 8.5. A = /cq^o + kiEi + k2e2 G D{K,Kq) has eigenvalue —cl ^ 8 if and only if 
{ko, ki, /C2) is one of 

{ (±4, 0, 0), (±1, 1, 0), (±3, 1, 0), (0, 1,1), (±2, 1, 1), (0, 2, 0) }. 

Suppose that A = (±4,0,0). Then dimV^ = 1. It follows from the branching law of 
(50(5), 50(2) X 50(3)) that k[ = 0. Thus -cl = 8. On the other hand, it follows from ( KWf 
that A = (±4,0,0) e D{K,K[^]). 

Suppose that A = (/cq, 1, 0). Then dim = 5 and VJ^ = Ukoeo ® C^ where A = ei E D{K) 
corresponds to the matrix multiplication of 50(5) on C^. It follows from the branching law 
of (50(5), 50(2) X 50(3)) that k[ = ±1. Hence -cl = + |. Notice that Ukoeo ® can 
be decomposed into the following 50(2) x 50 (3)-modules: 

Ukoeo ® = {Ukoeo ® (C' © {0})) © {Uk^eo ® ({0} © C^)), 

where Uko^o © ({0} © C"^) has no nonzero fixed vector by Z2 x 50(3). If ko is odd, then 



Pko 



£0+£l 



W2 





-Inko 



V © 



-W2 






V © 



i-e-, (^a)z; 



(g)SO(3) — Ukoeo 



(C^ © {0}) if ko is odd. But since 

/ Wi\ ( w-\ 



W2 





:oeo+e 



W2 




VV 



Wi 




VV 



Ukoeo © (C^ © {0}) has no nonzero fixed vector by (Z2 x 50(3)) ■ Z4, i.e., neither (±1, 1, 0) and 
(±3,1,0) is inD(K,K[„]). 

Suppose that A = {ko, 1, 1). Then dimVj^ = 10 and V"^ ^ C © A^C^ It follows from the 
branching law of (50(5), 50(2) x 50(3)) that k[ = 0. Thus -cl = ^k^ + 6. On the other 
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hand, since d A 62 G A^C^ is fixed by 5*0(2) x S0{3), w (g) (d A 62) G C (g) A^C^ is fixed by 
Z2 X 50(3) C 50(2) X 50(2) X 50(3). Moreover, 



Pkoeo+e^+e2i9)i^' ® (ci A 62)) = 6^ '^'^''v ® (ca A Ci). 

Hence, A = (0, 1, 1) ^ D{K,K[^]) but A = (±2, 1, 1) e D{K,K[^]) and (V^^)a-m = C^CjeiAes} 
for fco = 2 or —2, botfi of which give eigenvalue 8. 

Suppose that A = (0, 2, 0). Then dim = 14 and = C(gSo(C^), where the representation 
of 50(5) with highest weight 2ei is just the adjoint representation on So(C^). It follows from 
the branching law of (50(5), 50(2) x 50(3)) that k[ = 0, ±2. Thus -cl = 10 - ifc^l When 
k[ = ±2, —cl = 8, otherwise —cl = 10 > 8. On the other hand, So(C^) can be decomposed 
into the following 50(2) x 50 (3)-modules: 

= S2(C2)©S2(C=^)©M(2,3;C)©{(^''q' | 2, w G C, 2^ + 3m; = o}. 

Thus, Sl{C^) is fixed by {-h} x 50(3) and 

(VA)i^o = C®S2(C2)©C©C 



3/2 



-2h 



Moreover, 





fa b ] 




(-a b \ 




b —a 








\ 0) 







Hence, (V^A)/^[a] = C©C-|^10 j©C®c(^^^^ _2j^ ^ • Therefore, A = (0, 2, 0) G 

D{K, K[a])- Notice the first summand lies in V^q 20)® ^(0 -2 0) which gives eigenvalue 8 and the 
second summand lies in V^q q which gives eigenvalue 10. Hence the multiplicity corresponding 
to eigenvalue 8 is 1. 

Since A = (4,0,0), (-4,0,0), (2,1,1), (-2,1,1), (0,2,0) G D{K,K[^i) give the smallest 
eigenvalue 8 with multiplicity 1 and 

n{L^) = dim 1^(4^0,0) + dim V'(_4^o,o) + dim 1^(2,1,1) + dim V'(_2,i,i) + dim 1^(0,2,0) 
= 1 + 1 + 10 + 10 + 14 = 36 

> 34 = dim 50(10) - dim 50(2) x 50(5) = n^kiL^), 

Q{N^) C Qs{C) is not Hamiltonian rigid. Therefore ^(A^*^) C QsiC) is Hamiltonian stable 
but not strictly Hamiltonian stable. 

(in) The case ^(A^^^) - (SSg-^tz. ^ Q^pi^) ^i^h p>3. 

Suppose that A = (^o, 0, 0) and ko e AZ\ {0}. Then k[ = and by ^Ml A G D{K, K[„]). As 
p > 3, we have 16 < 24 < 8p. Hence by fl8.10p we see that for every fco G 4Z \ {0} such that 
16 < A:^ < 8p we have eigenvalue -cl = < 4p. Therefore, ^(A^^^) = (|^x5of2p-f)>Z4 
Q4p-2(C) is not Hamiltonian stable if p > 3. 

Therefore, we obtain 
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Theorem 8.2. The Gauss image L'^p = (Z2xso(2p-i))Z4 ~^ Q4p(C) {p > 1) is not Hamiltonian 
stable if and only (m — 2) — 1 = 2p — 2 > 3. If p = 1, it is strictly Hamiltonian stable and if 
p = 2, it is Hamiltonian stable but not strictly Hamiltonian stable. 

Remark. The index i{L'^'^) goes to oo as p — oo. 



9. The case (f/, K) = {SU{m + 2), S{U{2) x U{m))) {m > 2) 

In this case, U = SU{m + 2) and K = S{U{2) x U{m)) with m > 2. Then {U, K) is of B2 
type for m = 2 and BC2 type for m > 3. 

In this case we use the formulation by the unitary group U (m) rather than one by the special 
unitary groups SU{m). It seems to work more successfully in our argument of applying the 
branching laws. Here we will also indicate the relations between both formulations. Let 
U := U{m + 2), K := U{2) x U{m), := U{2) x U{2) x U{m - 2), := f/(l) x f/(l) x 
U{1) X f/(l) X U{m-2) and Kq := f/(l) x [/(I) x U{m-2). Then f/ = C{U)-U, K = C{U)-K, 
K2 = C{U) ■ K2, K\ = C{U) ■ Ki, and Ko = C{U) ■ Ko, where C{U) is the center of U. 

Let u = t + p and u = t + p be the canonical decomposition of u and u corresponding to 
(f/, K) and {U, K), respectively. Let a be a maximal abelian subspace of p, where 



a 





-"12 



H12 




H 



12 



6 
6 







Then the centralizer Kq of a in K is given as follows: 



Ko = i 



P 



At 



\ 



T e U{m - 2) 



f/(l) X f/(l) X f/(m-2). 



Moreover, 
where 



Ki,] =Ko^{Q- Ko) U (g' ■ i^o) U ■ 



g 



/O 1 

-1 



V 



-1 
-1 



-2/ 



e K2 c K. 



Thus the deck transformation group of the covering map Q : A^8m-2 _^ ^j^jY4m-2^ ^ 2) is 
equal to i^ioj/i^o — K[a]/Ko = Z4. Remark that we will use P and Q to denote the element in 
Kq and the generator of Z4 in i^rd throughout this section. 



9.1. Description of the Casimir operator. 

Define an inner product (X, Y)^ := —tiXY for each X,Y E u = su(m. + 2) or for each 
X, y G u = u(m + 2) . The restricted root system T,{U, K) is of type B2 for m = 2 and type 
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BC2 for m > 3. Then the square length of each restricted roots with respect to ( , )u, is given 

by 

II ||2 _ / 1 oi' 2, 171 = 2; 
" \ i, 1 or 2, m > 3. 

Hence the Casimir operator Cl of L with respect to the induced metric from 5'q4,„_2(c) be 
expressed as follows: 



Cr 



CftT/A'o ~ I Cki/Ko, m — 2; 



where Ck/Kq^ ^K2/Ko ^Ki/Kq denote the Casimir operator of K/Kq, K2/KQ and Ki/Kq 
relative to ( , )u|f, ( , )u\i2 and ( , )u|ti5 respectively. 

9.2. Descriptions D{U), D{U) and etc. 

D{U), D{C{U)) and D{U) are described as follows: 

D{U) = D(f7(m + 2)) = I A = piyi H h Pm+22/m+2 I Pi, ■ ■ ■ , e Z, 

Pi -Pi+i > (i = 1, ■ ■ ■ ,m + 

D{C{U)) = D{C{U{m + 2))) = {a = p,{y, + ■■■ + | Po e ^^z), 

I m + 2 J 

m+2 

^(t/) = D(^f/ (m + 2)) = I A = piyi + ■ • • + Pm+2ym+2 | ^ Pi = 0, 

i=l 

Pi -Pm+2 e Z,Pi -pi+1 > (z = 1, ■ ■ ■ ,m + 
Each A = piUi + ■ ■ ■ + Pm+2ym+2 G D{U{m + 2)) can be decomposed as A = A° + A, where 

m+2 \ /m+2 \ 

[J:y^jeDiCiU{m + m 

and 

^ m+2 ^ m+2 
A = (Pl ^ y]Pi)2/l + ■■ ■ + (Pm+2 — 7 y'pi)2/m+2 G (5f/(m + 2) ) . 

m + 2 m + 2 

i=i 1=1 

Note that this projection D{U) D{U), A t-^ A is surjective. 



D{k) = D{U{2) X U{m)) 

={A = qiyi + g2Z/2 + gsl/s H h gm+2l/m+2 I 

gi G Z (z = 1, ■ ■ ■ ,m + 2),gi - ga > 0,gi - gi+i > (z = 3, ■ ■ ■ ,m+ 1)}, 

D(i^) = £'(5(f/(2) X U{m))) 

m+2 

--{A = qiVi + 522/2 + gsZ/S H h gm+22/m+2 I X] ^ ^' "^3^^ 

i=\ 

(z,j = 1,2, • ■ ■ ,m + 2),gi - g2 > 0,gi - gi+i > (i = 3, 4, ■ ■ • , m + 1)}, 
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D{K2) = D{U{2) X U{2) X U{m - 2)) 

={A = qivi + g2l/2 + gsZ/s + QaVa + gsZ/s H h gm+2Z/m+2 I 

e Z (z = 1, - ■■ ,m + 2), 
gi - ^2, - 94, - > (z = 5, ■ ■ ■ , m + l)}, 
L>(K2) = D{S{U{2) X f/(2) X f/(m - 2))) 

m+2 

= {A = qiVi + ^2^/2 + 932/3 + QaVa + 95^/5 H h gm+22/m+2 | = 0, 

j=l 

Qi-qj eZ = 1,2,- ■■ ,171 + 2),gi - ^2,^3 - 94,?* - gi+i > (i = 5, ■ ■ ■ , m + 1)}, 
D{Ki) = D{U{1) X f/(l) X U{1) X X U{m - 2)) 
={A = qiyi + ^22/2 + ^32/3 + qm + %yb h \- qm+2ym+2 I 

e Z (i = 1, ■ ■ ■ , m + 2), gi - g^+i > (i = 5, ■ ■ ■ , m + 1) }, 
= X f/(l) X f/(l) X U{1) X ?7(m - 2))) 

m+2 

=|a = gii/i + g2?/2 + q-sVs + qm + gsl/s h ^ gm+2ym+2 I ^ gi = 0, 



i=l 



qi-qj eZ = !,■■■ ,m + 2),qi - g^+i > (z = 5, ■ ■ ■ , m + 1) j , 
^(i^o) = ^(f/(l) X U{1) X t/(m - 2)) 

= {A = qiyi + g2y2 + q-m + ^42/4 + gsZ/S H h gm+2Z/m+2 I 

^3 = e ^Z, g4 = g2 G ^Z, gi e Z (i = 5, ■ ■ ■ , m + 2), 

gi - qi+i > (i = 5, 6, ■ ■ ■ , m + 1)}, 
^(/sro) = D{S{U{1) X X U{m - 2))) 
={A = giyi + g2?/2 + 93^3 + 94^/4 + gs^/s H h qm+2ym+2 I 

m+2 

^ g, = 0,gi - gj G Z (i, j = 1, • • • , m + 2), 

gs = gi, g4 = g2, qi - qi+i > (z = 5, ■ ■ ■ , m + 1)}. 

The natural maps — > D{K), D{K2) — > D{K2), D{ki) — y D{Ki) and D(A'o) 
L'(i^'o) are also surjective. 

9.3. Branching laws of (U{m), U{2) xf/(m — 2)). The branching laws for {SU{m), S{U{m) x 
U{2))) given in [22] can be reformulated to the branching laws for {U{m), U{2) x U{m — 2)) 
as follows: 

Lemma 9.1 (Branching law of (?7(m), U{2) x U{m — 2))). For each A = pi^/i + ■ ■ ■ +Pmym G 
D{U{m)), an irreducible U{m)-module Vj^ with the highest weight A can he decomposed into 
the direct sum of irreducible U{2) x U{m — 2) -modules as follows: 

= © 

A'€D{U{2)xU{m~2)) 
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Here contains an irreducible U{2) x U{m — 2) -module V^, with the highest weight A' = 
QiVi + ■ ■ ■ + (jmUm ^ D{U{2) X U{m — 2)) if and only if the following conditions are satisfied: 

(i) qi - pi e Z; 

(ii) Pi-2 >qi>Pi (i = 3, ■ ■ ■ , m); 

(iii) In the finite power series expansion in X of — ^~'^(^x — ' ^^^'^^ 



r2 



Pi - max(g3,p2) 

min(gi,pj_i) - max(gi+i,pj), (3 < i < m - 1) 
mm{qm,Pm-i) ~ Pr, 



-'mi 



the coefficient of X^^ ^^'^^ does not vanish. Moreover, the value of this coefficient is 
equal to the multiplicity of the irreducible U{2) x U{m — 2) -module V^, . 

9.4. Branching law of (f/(3), U{2) x f/(l)). Now following Lemma [7.11 the branching law of 
([/(3),f/(2) X f/(l)) is described as 

Lemma 9.2. Let be an irreducible U{3)-module with the highest weight A = piyi + P2y2 + 
P3?/3 £ D{U{3)), where G Z (z = 1, 2, 3) and Pi > P2 > Ps- Then can be decomposed into 
irreducible U{2) x U{1) -modules as 

Pl~P2 P2-P3 

^iyi+P2y2+P32/3 = ^(pi-a)»/i+(P2-/3)y2+(P3+a+/3)y3- 
a=0 13=0 

9.5. Descriptions oi D{K,Ko), D{K2,Ko), D{Ki,Ko)- Let 

^ = Pm + p2y2 + P-m + ■ ■ ■ + Pm+2ym+2 e D{iq = D{u{2) xU{m)), 

where pi,--- ,pm+2 G Z, pi > pa, Ps > ■ ■ ■ > Pm+2- Thus = pm +^2^/2 e £'(t/(2)), 
K = PsVs H \- Pm+2y;n+2 E D{U (m)) and 

P'^ = aMre V{k) = V{U{2) x f/(m)), 

where a e I?(f/(2)), r G D(t/(m)). 

By Lemma an irreducible ?7(m)-module V-r with the highest weight A,- can be decom- 
posed into the direct sum of irreducible U{2) x U{m — 2)-modules as 



where A; = ET=3^^y^ e D{U{2) x U{m - 2)) with gg, ■ ■ ■ , e Z, - g^+i > = 
3, 5, • ■ ■ , m + 1). Note that setting A^ := q^y^ + ^41/4 G D{U{2)) and A^ := 557/5 + ■ ■ ■ + 
qm+2ym+2 G D{U{m — 2)), we get a decomposition into the direct sum of irreducible K2- 
modules as 
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By the branching law of {U{2), U{1) x U{1)) (see Lemma rTTj) . 



P1-P2 



2+a)y2' 
a=0 

g3-<?4 



(93-/3)2/3 + ('J4+/3)i/4- 
/3=0 

Thus we have a decomposition into the direct sum of irreducible /sTi-modules: 

P1-P2 qz-qA 

= ® ® ® (^(k-«)?/l+(P2+a)?/2 ^ ^('g3-/3)?/3 + (<74+/3)?/4 ^ ^95?/5 + -+gm+2!/m+2)- 

Q=0 /3=0 

Since as a f/(l) x f/(l)-module 

^ {Pi-a)yi+{p2+a)y2 ^ {q3-0)yi+{qi+P)yA \{pi+q3~OL- I3){yi+ya)+\{p2+qi+a+l3)(y2+yiy 

we have a decomposition into the direct sum of irreducible Kq -modules: 
~ ^^(^iyi+P2y2 ^ ^qzy^+qAVA ^ ^gsj/sH — \-qm+2ym+2) 

P1-P2 93-94 

= ® ® ® (%i-a)S/l + (p2+Q)j/2 ^ ^(g3-/3)j/3 + ('?4+/3)s/4 ^g5y5 + -+gm+2ym+2) 

0=0 /3=0 
Pi-j52 93-94 

= ® ® ® ^|(pi+g3-«-/3)(yi+y3)+|(p2+94+a+/3)(y2+?;4) ^ ^g5J/5 + -+'?m+2?/m+2 • 

0=0 /3=0 

Thus we obtain that A G D{K, Kq) if and only if there exist a, /3 G Z with < a < pi — p2 
and < /3 < ^3 — ^4 such that 

|(Pl+Q3-a-/3)(?/l+S/3) + 5(P2+g4+a+/3)(2/2+y4) '''?5S/5 + -+'7m+2J/m+2 

is a trivial -fCo -module, that is, 

+ - a - /3 = 0, 
P2 + ^4 + tt + /3 = 0, 

% = ■■■ = qm+2 = 0. 
Hence A G D{K,Kq) must satisfy 

P5 = P6 = ■ ■ ■ = = 0, 

P3 > P4 > 0, < Pm+1 < 0, 

Pi + P2 + P3 + P4 + + Pm+2 = 0. 

If m > 4, then each A G D{K, Kq) is expressed as 

A = plUl + ^2^/2 + PsUS + ^4^/4 + Pm+ll/m+l + Pm+2|/m+2, 
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where pi e Z, pi > p2, ps > Pa > > Pm+i > Pm+2, 

Pl+p2+p3+p4+ Pm+1 + Pm+2 = 0. 

If m = 3, then each A G D{K, Kq) is expressed as 

A = piVi + p2y2 + p-m + PiVi + P5I/5, 
where pi G Z, pi > p2, Ps > P4 > P5, Pz >0,p5< 0, 

Pi + p2 + p3 + p4. + p5 = 0. 

If m = 2, then each A G -D(-ft', i^o) is expressed as 

A = Piyi+ p2y2 + P-m + Pm, 

where pi eZ, pi> p2, ps > pi, pi+ P2 + + P4 = 0. 

Correspondingly, each A' G D{K2, Kq) is expressed as A' = piyi + p2y2 + Q-iVs + 0^42/4, where 
Pi,P2, gs, 94 e Z, pi > gs > ^4, Pi + P2 + gs + ^4 = O, in other words, pi + p2 + p3 +Pi + 
pm+i + Pm+2 = if m > 4, pi + p2 + P3 + p4 + p5 = if m = 3. Each A" G D{Ki, Kq) is 
expressed as A^' = q[yi + g^|/2 + gg^/s + ^41/4, where q[, q'^, gg, g4 eZ, q[+^^ = 0, + = 0, 
g'^ = —a + pi, q2 = C( + p2 for some a = 0, ■ ■ ■ , — P25 and gg = — /3 + qs, q'^ = /3 + q^ for some 
^ = 0, ■ ■ ■ , gg - g4. 

Moreover the coefficient of X'^^~^'^~^^ in 



X -X 



P3-P4 



^J^P3-P4 + 1 _ J^-(P3-P4 + l)^^J^Pm + l-Pm + 2 + l _ J^-(Pm + l-Pm+2 + l) j 



_ ^ ^J!^(P3-P4) + (Pm+l-Pm+2)-2i+l _ (p3 -P4)- (Pm + 1 -Pm+2 ) -2i- 1 j 

is equal to the multiplicity of the i^'2-niodule with the highest weight A' = A^- + A'^ = piyi + 

P21/2 + gsi/s + qm e ^(^2, ^o)- 

9.6. Eigenvalue computation when m = 2. For each A = piyi + P2I/2 + PsVs + P4I/4 G 
Kq) and A" = g^i/i + g2?/2 + gsZ/s + g4l/4 € D{Ki, Kq) defined as above, the corresponding 
eigenvalue of —Cl is 

1 

—Cl — — + 

(9.1) = + P2 + P3 + P4 + (Pi - P2) + (P3 - Pa) 

-\U)' + m' + {%f + {m- 



Since 

the first eigenvalue of — C^, —cl < n = Q implies — < 12. By estimating the eigenvalue 
formula (19.11) from above by 6, we compute 

56 



Lemma 9.3. A = piyi + + PsVs + ^4^/4 ^ D{K, Kq) has eigenvalue —cl < 6 and only 
«/(^i,P2,P3,P4) is one of 

{(0,0,0,0), (1,1, -1,-1), (1,0, 0,-1), (1,-1, 0,0), (1,-1, 1,-1), 

(1, 1, 0, -2), (2, 0, -1, -1), (0, -1, 1, 0), (0, 0, 1, -1), 

(0,-2, 1,1), (-1,-1,2,0), (-1,-1, 1,1)}. 

Denote A = Pm + p2y2 + PsVs + PiVi e D{k,ko) by A = (pi,P2,P3,P4)- 
Suppose that A = (1, 1, -1, -1). Then dime V^a = 1- % the branching law of (f/(2), f/(l) x 
t/(l)), {q[,q'2,q'3,qi) = (1,1,-1,-1) G D{k,,ko). Then -c^ = 4, -c^,, = 4, -cl = -c^ + 
Ic^// = 2 < 6. On the other hand, = C Kl C, which is fixed by the pAl/?o"^ction. But for 
a generator Q of Z4 in A'[n], pj^iQ) = —Id on V^. Hence, A = (1,1,-1,-1) ^ /^(K, A'jd]). 
Similarly, A = (-1, -1, 1, 1) ^ D(i^, i^[„]). 

Suppose that A = (1,0,0,-1). Then dime = 4. It follows from the branching law 
of (f/(2),f/(l) X f/(l)) that (g;,g^) = (1,0) © (0,1) and (g^,gi) = (0,-1) or (-1,0). Then 
(gl,g2,f3.^4) = (1,0,-1,0) or (0,1,0,-1) G D{k,,ko). Hence, -c^ = 4, -c^. = 2, -c^ = 

Let V{SU (2)) = {(V^, p^) I £ e Z, £ > 0} be a complete set of inequivalent irreducible unitary 
representations of SU{2) described in Section Let {vQ\vf'\ ■ ■ ■ ,vf^} be a unitary basis of 
Ve defined by (15. ip . Then 

The representation of A'o on v^^^ ® Vj^^ G {i,j = 0, 1) is given by 



Then (V^) = span(-.{'u[^^ (g) ^^q^^ ^^q^^ ® '^^i^''}. But for diag(l, 1, —1, —1) G K[a] and i,j = 0, 1, 
PA(diag(l,l,-l,-l))(i;f) ) = -vi''>^vf\ So (\4)i?(„, = {0} and A = (1,0,0,-1) ^ 

D{k, ki,]). Similarly, A = (0, -1, 1, 0) ^ D{k, /?[„,). 

Suppose that A = (1,-1,0,0). Then dime = 3. It follows from the branching law 
of (t/(2),[/(l) X f/(l)) that {q[,q',) = (1,-1), (0,0) or (-1,1) and {q'„q',) = (0,0). Then 
(q'l, q2, ^3, Qi) = (0, 0, 0, 0) G D{k, ko). Hence, -c^ = 4, -c^„ = 0, -cl = -c^ + ^c^" = 4 < 6. 

~ (2) 

On the other hand, = V2 Kl C. The representation of Kq on f ^ ® w G is given by 
Then (Vjijf^^ = spandfj^ ® w}. But for the generator Q G K[a], 

So (^a)%, = {0} and A = (1, -1, 0, 0) ^ D{k, A'^)- Similarly, A = (0, 0, 1, -1) ^ D{k, iT^). 
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V^(s-t) 



/5l 



Suppose that A = (1,-1,1,-1). Then dime = 9. It follows from the branching laws 
of {U{2),U{1) X f/(l)) that {qlq'2) = (1,-1) or (0,0) and (g^,gi) = (1,-1) or (0,0). Then 
{q[,q'2,q's,q4) = (1,-1,-1,1), (-1,1,1,-1) or (0,0,0,0) G D{k,k^). When (g^, g^, g^, g^) = 
(0, 0, 0, 0), -c^ = 8, -c-^„ = 0, -CL = -CA + |c^" = 8 > 6. When (g^, g^, g^, g^) = (1, -1, -1, 1) 
or (—1, 1, 1, —1), —C]y = 8, — c^// = 4, —cl = —cj^ + \cj^,, = 6. On the other hand, = V2 Kl V2. 



The representation of Kq on ® vy G = 0, 1, 2) is given by 



(2) 



,(2)^ 



P2 



e 2 



(2)^ 



^gV^(s-t)[2-(,,+j)]^(2)^^(2)_ 

Hence (V^) = span^jfo^^ ® t>2^'*, f j;^"* ® vf^ 



P2 



v^^}. Moreover, the action of the generator 



Q of Z4 in K[a] on vl (g) f j^"" is given by 



,(2) 



,(2) 



3-i„,(2) 



,(2) 



Therefore, (V^A)i^j^, = span{t;^^^ ® i;^^^ - t;^^^ ® ^^o"^ ® ^'D and A = (1,-1,1,-1) G 
i5(J?, -ft'jn]). Note that the i^[(j]-fixed vector vf'^ ® v^'^ G VJ, which corresponds eigenvalue 

8 and the ^[aj-fixed vector vj^^ ® ^ - ^ ® i;^^^ G Vy^_y^_y.^^y^ © K^y^+y^+yg-y^, which gives 
eigenvalue 6. 

Suppose that A = (2,0,-1,-1). Then dime = 3. It follows from the branching law 
of (?7(2),[/(l) X f/(l)) that (gl,gl) = (2,0), (1,1) or (0,2) and (gl,gl) = (-1,-1). Then 
{q'i, Qs^ Q4) = (1' 1' -1) ^ D{K, Kq). Hence, -c^ = 8, -c^,, = 4, -c^ = -c;^ + ic^,, = 6. 
On the other hand, 

= {V2 ® C) K c. 

The representation of A^o on ir <S) w E Vji^ {i = 0, 1, 2) is given by 

I e 

P2 



-lis+t) 



-l(s-t) 



(2)^ 



w 



-l{s-i)(l-i)„{2) 



Hence, (Va)^^^ = spandt^j^^ (g) 1}. Moreover, the action of the generator Q of Z4 in K[a] on 



,(2) 



ti? is given by Px{Q){'^f^ ® 1) = (—1)^ *^'2-j ® 1- Therefore, (V^) 



l-i.,(2) 



span{t;(^^ (g) 1} 



and A = (2,0,-1,-1) G D{K , K\^a]), which gives eigenvalue 6. Similarly, A = (-1,-1,2,0), 
(1, 1, 0, —2), (0, —2, 1, 1) G D{K, i^[a]), which give eigenvalue 6 and with multiphcity 1, respec- 
tively. 

Moreover we observe that 

n{L^) = dime V(2,o,-i -1) + dime V(_i _i,2,o) + dime V(i,i,o -2) 

+ dime V(o _2,i,i) + dime V(i „i) = 3 + 3 + 3 + 3 + 9 
=21 = dim 50(8) - dimS{U{2) x U{2)) = nhk{L^). 
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Therefore we obtain that = ^( g([7(i)xc/(i)) ) Qei^) is strictly Hamiltonian stable. 

9.7. Eigenvalue computation when m = 3. For each A = +P2?/2 +P3I/3 +^42/4 +^5^/5 G 
DiK, Ko), A' = pm + P2y2 + gsZ/a + qm e D(^2, ^o) and A" = q[yi + q'^y2 + q'^ys + q'^Vi e 
D{Ki,Ko) given as in Subsection 19.51 the corresponding eigenvalue of —Cl is 

1 

—Cl — — 2c^ + c^, + -c^„ 
(9-2) =Pi+Pl + 2{Pl +Pl+ Pi) + {Pi - P2) + 4(p3 - ps) 

- (?1 + ql) - {h - ~q.) - \{{q[f + (g^)' + {%? + 

A = PiZ/i + + + P41/4 + e D{k,ko) is denoted by A = (pi,p2,P3,P4,P5)- Since 
— Cl > — ^Cx/iTo' eigenvalue of —Cl, —cl < n = 10 implies — c^^ < 20. It then follows that 

Lemma 9.4. A = piyi + p2y2 + PsVs + PaVa, + P^Vb G D{K,Kq) has eigenvalue —cl < 10 if 
and only if {Pi,p2,p3,p4,p5) is one of 

{(0,0, 0,0,0), (1,-1, 1,0,-1), (2, 0,0, -1,-1), (0,-2, 1,1,0), 
(1,1, 0,0, -2), (-1,-1,2, 0,0), (1,-1,0, 0,0), (1,0, 0,0,-1), 
(0,-1, 1,0,0), (1,1,0, -1,-1), (-1,-1, 1,1,0), (0,0, 1,0,-1)}. 

Suppose that A = (1,-1,1,0,-1). Then dime = 24. It follows from Lemma Wl2\ 
that (93,^4, Q's) = (1,-1,0) or (0,0,0). When (^3, 5^4, 5^5) = (0,0,0), by the branching law of 
(f/(2),f/(l) X U{1)), {q[,q'^,q^„q'^,q',) = (0,0,0,0,0). Hence, -Cl = -2c-^ + Cj,, + ^Cj^,, = 
16 > 10. When (qs^q^^q^) = (1,-1,0), by the branching law of (f/(2),[/(l) x [/(I)), 
iq'i,q2,qs^qlq5) = (1,-1,-1,1,0), (0,0,0,0,0) or (-1,1,1,-1,0) G D{k,ko), respectively. 
Hence, —cl = — 2c^ + c^, + lc^„ = 10, 12 or 10, respectively. On the other hand, now 

{V2 K 1/2 K C) © (\/2 K C K C), 



where the latter is a i^^2-module. The representation pj^ of Kq on -Uj (g) f ^ (g) w e V2 KI V2 KI C 
{hi = 0, 1,2) is given by 

P'^{P){vf^ ®vf ®w) 
= Pyi-y2 ( ^ ' gV=Tt ) ^^'^^^) ® Py^-y^ ) ^^'f ^) ® ^ 



^^s-t)i2-^-,)J2) ^ (2) ^ ^ 



(2) 

The representation of Kq on ir (E) v ^ w E V2 ^ C M C {i = 0, 1, 2) is given by 

Pk{P){v? ®V®w) =Py,-y, ^ [Vf^) ®V®W 
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Thus, (V^) = span(-;{t4^^ ® (g) w, v^'^ ® vf^ ® w, v^^ ® v^^ ® w, v^^^ ® v ® w}. Moreover, 

~ f2) (2) 

the action of the generator Q of Z4 in K^^] on v- ® t^g-i ® is given by 
and the action on f ^ (g) ® u; is given by 

Therefore, (V^a)^^^^ = spanc{?;2 ® t^o ® ~ '^o ® '^2 ® '^5 '^i ® A = 

(1, —1, 1, 0,-1) G -D(/'i', -f^[o])- Notice that the i^Tf^j-fixed vector vl ®f 1 ®w G VJ^^//, which cor- 
responds eigenvalue 12, where A" = 0. And the /^[aj-fixed vector ^2 ®fo — ^"^2 G 
V^^l © V^», which gives eigenvalue 10, where A'/ = (1, —1, —1, 1, 0) and A2 = (—1, 1,1,-1,0). 

Suppose that A = (2,0,0,-1,-1). Then dime ~ 9. It follows from the branching 
law of (f/(3),[/(2) X f/(l)) that (^3,^4,55) = (0,-1,-1) or (-1,-1,0). When (ga, 54,^5) = 
(-1, -1,0), by the branching law of (f/(2), f/(l) x f/(l)), {q[, g^, , g^, g^) = (1, 1, -1, -1, 0). 
Hence, —cl = — 2c^ + c^, + |c^„ = 10. On the other hand, 

and the representation pj^ oi Kq on vl ® v ® w E V2 ^ C ^ C (i = 0, 1, 2) is given by 



Thus, (V^) = spanQ{t>(^^ ®v®w}. Moreover, the action of the generator Q of Z4 in K^^] on 

f2) 

v] ®v ®w IS given by 

PA(<3)(^f ^ ® t; ® u;) = p2yi J ^ (^^f ^) ® P-(y3+j/4) 0^ ) ® ^ 

= (-1)^+S£®W®W. 
~ (21 ~ ~ 

Therefore, iVj^Ky^^ = spandf^ ®v®w}, where dimc(V^)jf|^j = 1 and A = (2,0,0,-1,-1) G 

D{K, K[a]), which gives eigenvalue 10. Similarly, A = (0, —2, 1, 1, 0) G D{K, -^[o])) which gives 
eigenvalue 10 and with multiplicity 1 and dimension 9. 

Suppose that A = (1,1,0,0,-2). Then dime VJ^ = 6. It follows from Lemma W72\ that 
(gs, g4, gs) = (0, 0, -2), (0, -l, -l) or (0, -2, 0). When (gs, g4, gs) = (0, -2, 0), by the branching 
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law of ([/(2), U{1) X [/(I)), {q[, q',, g^, q'„ q',) = (1, 1, -1, -1, 0). Hence, -Cl = -2c^ + c^, + 
^C]i^„ = 10. On the other hand, 

and the representation pj^ of Kq on u ® v^"^^ G C Kl V2 Kl C (z = 0, 1, 2) is given by 

=Pyi+y2 ^ ~ ) (^) ® P-2y4 (^^ ' ) (^'f ^) ® ^ 

Thus, (V^) = span(-;{-u 0v[ 1^ w}. Moreover, the action of the generator Q of Z4 in K^^] on 
u ® ® w is given by 

Therefore, (V^)^^^^ = spandu (8) ® u;}, where dimc(V^)/^j^j = 1 and A = (1, 1,0,0, —2) G 

i^ja]), which gives eigenvalue 10. Similarly, A = (—1,-1,2,0,0) G D{K, K[a]), gives 
eigenvalue 10 and has multiplicity 1 and dimension 6. 

Suppose that A = (1,-1,0,0,0). Then {qi,q2, (13,(14,(15) = (1, — 1, 0, 0, 0). It follows from 
the branching law of {U{2), U{1) x f/(l)), {q[, q'^, q'^, q^ q'^) = (0, 0, 0, 0, 0) G D{ki, Kq). Hence, 
-Cl = -2c^ + c^, + ic^„ = 4 < 10. On the other hand, V^^ = Wy^.y^ ^Wo = V2^C and the 
representation of Kq on Ui ® w E V2 ^ C (z = 0, 1, 2) is given by 

Pj^{P){Ui® w) = p2 (^'^ ~ ' ^^^s^^{Ui)0W 

Thus, (V^)xq = SpanQ{ui®ti'}. Moreover, the action of the generator Q of Z4 in K^a] on ui^w 
is given by P/^{Q){ui ^ w) = —ui (g) w. Therefore, (V^)^^^^^ = {0} and A = (1,-1,0,0,0) ^ 

Suppose that A = (1,0,0,0,-1). It follows from Lemma 19.21 that (q's, q'4, q's) = 
(0,0,-1) or (0,-1,0). When (g3,g4,g5) = (0,-1,0), by the branching law of (t/(2),f/(l) x 
[/(I)), (gl,g^,g^,gl,g^) = (1, 0, -1, 0, 0) or (0, 1, 0, -1, 0) G D{K,,Ko). Hence, -cl = 
-2c^ + Cji^, + ic^„ = 5, 5 < 10. On the other hand, (V^;^) C Wy, K VT-y^ ^Wq = VimVimC, 
where the latter is the K2 = U{2) x U{2) x f/(l)-module. The representation p^ of i^o on 



vl ' ® vy w e ViMViM C {i, j = 0, 1) is given by 



p^(P)(t;f ) ® t;]') ® w) = ev^(^-*)(i-^-^^) t;f ^ ® ^7]^^ ® w;. 
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Thus, (Va)/^^ = spandf j^-* ® vj^^ ® w,uo® v[^^ ® w}. Moreover, the action of the generator Q 
of Z4 in K[a] on v^^^^ ® ® w (z = 0, 1) is given by 

Therefore, {VjC)k^^^ = {0} and A = (1, 0, 0, 0, -1) ^ L>(K, Ki^]). Similarly, A = (0, -1, 1, 0, 0) ^ 

Suppose that A = (1,1,0,-1,-1). It follows from Lemma 19.21 that {qzAiA^j = 
(0, -1, -1) or (-1, -1,0). For the element (pi,P2, gs, 94, ^5) = (1, 1, -1, -1,0) in L'(J?2,^o), 
by the branching law of (f/(2),f/(l) x f/(l)), (gl, g^, g^, g^) = a, 1,-1,-1) e D{k,,ko). 
Hence, -cl = -"^c-^ + c^/ + \ci„ = 6 < 10. On the other hand, (V^) C Wy^+y^ M W_y^^y^ Kl 
IVo = CKCKC, where the latter is the = U{2) x U{2) x f/(l)-module. The representation 
Pa of on n (g) f (g) G C Kl C Kl C is given by 

It follows that {yx)pco — span^jl (g) 1 (g) 1}. Moreover, the action of the generator Q of Z4 in 
K[a] OYi u®v ®w \s given by 

Pa{Q){u w) = -u V ® w. 

Therefore (Va)^^^, = {0} and A = (1,1,0,-1,-1) ^ D{k,ko). Similarly, A = 
(-1,-1,1,1,0) ^D(J?,i^o). 

Suppose that A = (0, 0, 1, 0, -1). It follows from the branching law of (t/(3), U{2) x f/(l)) 
that (g3,g4,g5) = (1^0, -1), (0,0,0), (1, -1,0) or (0,-1,1). For the element (pi,P2, gs, g4, gs) = 
(0,0,0,0,0) in D{k2,ko), by the branching law of (f/(2),f/(l) x U{1)), {q[, q'^, q'^) = 
(0,0,0,0) e D{Ki,Ko). Hence, -cl = -2ca + ca, + |ca// = 12 > 10. For the element 
(Pi,P2,g3,g4,g5) = (0,0,1,-1,0) in D(K2,i^o), by the branching laws of {U{2),U{1) x U{1)), 
(gi,g2,g3,g4) = (0,0,0,0) G D{ki,ko). Hence, -Cl = -2ca + ca, + |ca» = 8 < 10. On the 
other hand, {V];Jj^^ C V^o 0,0,0,0) ® ^(0,0,1.-1,0) • concerned with only V'(o,o 1,-1,0) siiice it 

corresponds to the smaller eigenvalue 8. Note that ^^(0,0,1, -1,0) = W"o^W"j/3-y4^W'o = CMV2^C, 
which is a K2-Taodu\e. The representation pA of i^o on m ® w | ® w G V^q q 1 _i q) = 0, 1, 2) 
is given by 

Pa(P)(m ® ^ ® w) = e^("-*^(^-^^)M ® t;f ^ ® w. 

Thus (Va)/;'^ = Span^jl ® Vi ^ 1} Q) ^"(00000)- Moreover, the action of the generator Q of Z4 

~ (2) 
in K[a] on u ® Vi ® w is given by 

Pa(<5)(^® ®u;) 

=M®P2(^ V~T ^'^Q^ ^ ® ""^ ^ ® "^1^^ ® ""^^ 

(2) ~ ~ ~ 

Therefore, 1 ® i^r^ ® 1 ^ (^A)i?[, and (\/A)i^„ = ^('0, 0,0,0,0)' which gives a larger eigenvalue 10. 
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Moreover, 

n(L^°) = dime V(i _i,i,o -i) + dime V(2,o,o + dime V(o -2,1,1,0) 
+ dime V(i,i,o,o,-2) + dime ^^(-1,-1,2,0,0) 
=24 + 9 + 9 + 6 + 6 = 54 

= dim 50(12) -dim 5(t/(2) x f/(3)) = ^^^(L^"). 

Therefore we obtain that L^^ = Q ( s{u{i)xu{i)xu{i)) ) ^ '^lolC) is strictly Hamiltonian stable. 

9.8. Eigenvalue computation when m > 4. For each A = piyi + ^2^2 + PsUs + ^4^4 + 
Pm+iym+i + Pm+2ym+2 G D{K, Ko), A' = + P2I/2 + ^32/3 + ^42/4 G -D(A'2, Kq) and A" = 
9i?/i + ^22/2 + ^32/3 + QiUi G D{Ki, Kq), the eigenvalue formula is 



-cl 



2c^ + c^/ + 2^A" 



Pi 



+ (l^i - P2) + 2(m 
(^3 - 



^2 



2(P3+P4+Pm+1 +Pm+2J 



^1) 



1)(P3 - Pm,+2) + 2(m - 3)(p4 - Pm,+l) 
. 1 



?4j 



((?ir + (g~2r + (?~3r + (gin- 



In case A = {pi,p2,p3,p4,Pm+i,Pm+2) = (^1,^2,0,0,0,0) G D{K,Ko), since p3 = Pa = Pm+i = 
pm+2 = 0, we have qs = Qi = = ■ ■ ■ = qm+2 = and thus q's = qi = 0. Since + P2 = 0, by 
the branching law of {U{2), U{1) x U{1)) we have = —a + pi, q'2 = a + p2 = a — pi = —q'l 
for some a = 0, 1 ■ ■ ■ ,pi — ^2 = 2pi. A e D{K, Kq) implies that q'l = q'2 = since q'l + q'^ = 
and ^2 + ^4 = 0. Then —cl = 2pi(pi + 1). 

Now A = piyi + p2y2 = 2pi|(yi - 2/2)- Set I 
P]^ of Kq on t'l^'' (g) w; G is given by 

-(s-i)/2 Q 

~(s-t)/2 



2pi. Then Vi=ViM C. The representation 



Pi 



e 



® w. 



Hence, {VjCikq — spanejf^^'' ® tf}. On the other hand, the action of the generator Q of Z4 in 
is given by 



Pa(Q)(4?®^ 



Pi 



1 
-1 

(^) 



(fj^f ) ® ^y 



Therefore, (V^)^^^^ = spane{t'^^'* ® w} for pi is even. As m > 4, for every even number 

pi > 2 such that 12 < 2pi(pi + 1) < 4m — 2, A = |5i(yi — 1/2) G -D(-ft', -ft'fa]) has eigenvalue 
12 < -Cl = 2pi(pi + 1) < 4m - 2. It means that L^"^'"^ C Q4m-2(C) is NOT Hamiltonian 
stable for m > 4. 

From these results we conclude 



Theorem 9.1. The Gauss image L 



4m- 2 



S(Ui2)xU{m)) 



c Q 



4m- 2 



C) (m > 2) is not 



~ S{U{l)xU{l)xU{m-2))-Z4 

Hamiltonian stable if and only if m> 4. If m = 2 or 3, it is strictly Hamiltonian stable. 
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Remark. The index i{L^"^ ^) goes to oo as m — )■ oo. 

10. The case {U,K) = {Sp{m + 2), Sp{2) x Sp{m)) (m > 2) 

In this case, K = Sp{2) x Sp{m) G U = Sp{m + 2), {U,K) is of type B2 for m = 2 and 
type BC2 for m > 3. Let u = t + p be the canonical decomposition of u and a be a maximal 
abelian subspace of p, where 

u =sp{m + 2) 

= { (^^^ ^ \Aeu{m + 2), B e M{m + 2, C), fi* = fij C u(2m + 4), 



t = 


= 5p(2)- 


\-5p{m] 










/ Al 





Bu 





\ 














-B22 






{ 







All 











I 


—B22 





^22 


/ 





1 





^12 


5i2\ 




^12 















—B12 


A12 


\ 












/ 





H12 


\ 






--^12 


















H^2 




\ 





- 


-H{2 y 





An e u(2), 5n G M(2, C), = 5n, 
A22 e u(m) , G M(m, C) , 5*2 = ^22}, 

|Ai2 G M(2,m;C),5i2 G M(2,m;C)}, 



if 



12 



^1 ■■■ 
6 ■■■ 



,ei,6GR . 



Then the centrahzer Kq of a in i^' is given as follows: 
Kq =Sp{l) X Spil) X Spim - 2) 



( ai 
02 



-61 0_ 
-62 



ai 
a2 



-61 
-62 



11 



61 
62 



ai 

0.2 



\ 



bi 
62 



ai 

(12 



A 



12 



v 



21 



A22/ 



ai 6i\ / a2 &2 
-61 ai / ' I -62 ^2 



) G 5p(l) = 5f/(2), (;^- ;^-)G^p(m-2)}. 



Moreover, 



= i^o u (g ■ /io) u ■ Ko) u (g^ ■ Ko), 
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where 



D 



/O 1 
1 



V 



1 
-1 



\ 



-2/ 



and Q 



D 
D 



Thus the deck transformation group of the covering map Q : A^^™ ^ — Q[N^' 
equal to K[a]/Ko = Z4. 



(m > 2) is 



10.1. Description of the Casimir operator. 

Denote {X, Y)^ := —^tiXY for each X,Y e sp{m + 2) C u(2m + 4). Then the square length 
of each restricted root relative to the above inner product ( , )u, is given by 



I Il2 

l7llu 



1 or 2, 
i,lor 2, 



m 



m > 3. 



Hence the Casimir operator Cl of L, with respect to the induced metric from fl'Qg^_2(c) "^^^ ^e 
expressed as follows: 



Cr 



2C 



K/Ko 



2 

-c 



m 



K2/K0 



-he 



2; 

m > 3, 



where Ck/Kq, ^k-^IKq and Cki/Ko denote the Casimir operator of K/Kq, K^jKi^ and Ki/Kq 
relative to ( , )u|e, ( , )u|t2 and ( , )u|fi, respectively. 

10.2. Descriptions of D{Sp{m)) and D{Sp{2) x Sp{m)). 

Let G = Sp{m) and K = Sp{2) x Sp{m — 2) in this subsection. Their Lie algebras are q 
and t, respectively. 



t = = v^diag(^i, ■ ■ ■ ,^m, -^1, ■ ■ ■ , -Cm) I C 



1) 



is a maximal abelian subalgebra t in both g and t. Let yi : ^ ^ he a. linear form on t. 
Then the fundamental root system of g relative to t is given by {ai = yi — 1/2, ■ ■ ■ , ^m-i = 
ym-i — Vmi ttm = 2?/^} a^d the fundamental root system of t relative to t can be given by 
{a' = yi- 1/2, a' = 2?/2, a's = 1/3 - Z/4, ■ ■ ■ , a^-i = Vm-i - Vm, = 2?/^}- Thus each A e D{G) 
for G = Sp{m) relative to t is uniquely expressed as A = piyi + ■ ■ ■ +Pmym with pi, ■ ■ ■ ,pm G Z 
and pi > P2 > ■ ■ ■ > Pm > 0. And also each A G D{K) for = Sp(2) x Sp{m — 2) relative to 
t is uniquely expressed as A' = gi?/i + ■ ■ ■ + gmZ/m with gi, ■ ■ ■ , gm £ Z and gi > g2 > 0, gs > 

• ■ ■ > gm > 0. 



10.3. Branching law of {Sp{2),Sp{l) x Sp{l)). 

Lemma 10.1 (Branching law of {Sp{2),Sp{l) x Sp{l)) [23], [17]). Lei Va &e an irreducible 
Sp(2)-module with the highest weight A = piyi + P2I/2 G D{Sp{2)), where pi,p2 G Z anc? 
Pi > P2 > 0. r/ien Va contains an irreducible Sp{l) x Sp{l)-module Va/ wi/i i/ie highest 
weight A' = qiyi + g2y2 G -0(5^(1) x Sp{l)), where gi, g2 G Z anc? gi > 0, g2 > 0, if and only if 

(i) Pi > g2 > 0; 
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(ii) in the finite power series expansion in X of ^'^"^'^ x-x-^ — ~' where ri[i = 0, 1) are 
defined as 

ro := pi - max(p2, ^2), := min(p2, ^2), 
the coefficient of X'^^'^^ does not vanish. 
Here that coefficient is equal to the multiplicity of a Sp{l) x Sp{l)-module V\i in V\. 

10.4. Descriptions of D{K,Kq) and D{Ki,Ko) when m = 2. 

For each A = pii/i +^'22/2 G D{K) = D{Sp{2) x 5*^(2)) with pi, ■ ■ ■ ,p4 G Z and 

Pi>P2> 0, P3 > P4 > 0, we know that piyi+ P2y2 e D{Sp{2)), p^ys + pm e D{Sp{2)) and 
Va. = W^piyi+p2?;2 ^ W^P3y3+P4?/4- By Lemma [Tom W^pi2/i+p2?/2 and 1^^3^3+^42/4 can be decomposed 
into irreducible Sp{l) x S'p(l)-moduIes as 

^Piyi+P2y2 = ^^^qiyi+g2y2' ^psyz+VAyi = ^<?3j/3+'?4?/4' 

where q'i,q'2 and q'3,q'4 vary as in Lemma [10. 1[ Thus we have a decomposition of Va into the 
direct sum of irreducible Sp{l) x Sp{l) x S'p(l) x S'p(l)-modules: 

2/1+92^2 ^ ^q-sy-i+qiyi)' 

91,92 93,94 

Further by the Clebsch-Gordan formula it can be decomposed into into the sum of irreducible 
5^(1) X 5'p(l)-modules as 

+94 -2i • 

91,9293,94 \i=l / \j=0 / 

Here we assume that qi > > and q'2 > q'4 > 0. Hence 

Lemma 10.2. A G D{K,Kq) if and only if there exist i,j G Z with < i < qs and < 
j < q^ such that Uq^+q.j^-2i Kl Uq^+q_^-2j is a trivial Sp{l) x Sp{l) -module. Then it must be that 
(?i,?2) = (g3,g4)- 

10.5. Eigenvalue computation when m = 2. For A = piyi +P2I/2 +P3Z/3 +P4Z/4 ^ D{K, Kq) 
and A' = qiyi + ^21/2 + qsVs + qiUA e D{Ki, Kq) with gi = gs, 52 = qi as in Lemma [10]2l the 
corresponding eigenvalue of —Cl is 

1 

-Cl = - ca + - ca' 
(10.1) 4 

= (5^ + 4pi + 2p2 + + 2^4) - (g? + ql + 2gi + 252) • 

i=l 

Denote A = piyi +pm + ^3^/3 + PaVa e D{K,Ko) by A = (pi,P2,P3,i?4)- Then using the 
eigenvalue formula (110. ip we compute 

Lemma 10.3. A G D{K,Ko) has eigenvalue —cl < 14 if and only if {pi,P2,P3,Pa) is one of 
{(0,0, 0,0), (1,1,0,0), (0,0, 1,1), (1,0, 1,0), (1,1, 1,1), (1,1, 2,0), (2, 0,1,1)}. 
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Suppose that A = (1, 1, 0, 0). Then dimcVA = 5. It follows from Lemma [10. II that (gi, ^2) = 
(0,0) or (1,1) and (^3,54) = (0,0). Then (gi, gs, gs, ^4) = (0,0,0,0) G D{Ki,Ko). Hence, 
— ca = 8, — ca' = 0, —cl = — ca + |ca' = 8 < 14. On the other hand, there is a double covering 
TT : 5^(2) — 50(5), and tt{Sp{1) x 5*^(1)) = 5*0(4). Let A5 denote the standard representation 
of 50(5) and 1 the trivial representation of 50(5). Then the complex representation of 
K = Sp{2) X Sp{2) with the highest weight (1, 1, 0, 0) is (A5 ® 1) ® C and Vk = It is easy 
to see that {Va)ko = Cei, where ei = (1, 0, 0, 0, 0)* G C^. However for 



1 



1 
-1 



1 

1 



v 



1 
-1 0/ 



7r(a) = diag(-l, 1, -1, -1, -1) ^ 50(4) and 7r(a)ei = -ei ^ ei. Therefore (VA)i^[„j = {0} 
and A = (1, 1, 0, 0) ^ D{K, K[„]). Similarly, A = (0, 0, 1, 1) ^ D{K, K[^]). 

Suppose that A = (1,0,1,0). Then dimcVA = 16. The corresponding representation with 
the highest weight A is just the complexified isotropy representation Adp(ii')'-'. Hence A ^ 
D(i^,i^H). 

Suppose that A = (1, 1, 1, 1). Then dimc\4 = 25. By Lemma OTOll (^1,^2) = (1, 1) or (0,0) 
and (53,54) = (1,1) or (0,0). Then (gi, 52, gs, ^4) = (1,1,1,1) or (0,0,0,0) G D{K,,Ko). If 
(gi, 92, gs, 94) = (1, 1,1,1), then -Cl = 10 < 14. If (gi, 52, 53, 54) = (0, 0, 0, 0), then -cl = 16 > 
14. On the other hand, V(i, 1,1,1) is exphcitly given as 

y^i^^^i^^) = C^mC^^ M(5,C). 
There are doubly covering homomorphisms 

7r:K = Sp{2) x Sp{2) — 
ttIk, : Ki = 5p(l) X 5p(l) X 5p(l) X Sp{l) - 
ttIk, : Ko = Sp{l) X Sp{l) - 



50(5) X 50(5), 
^ 50(4) X 50(4), 
^ 50(4). 

The representation of K on V\ is realized as the action of 7r{K) = 50(5) x 50(5) on 
M(5, C) in the following way: For each {A,B) G 50(5) x 50(5), X G M(5, C) is mapped to 
AXB-^ G Af (5, C). Then as a A'l-module, 



M(5,C) 





* 



* 




* 






* 



= W^(i,i,o,o) © W^(o,o,i,i) © ^(0,0,0,0) © 
Kq acts on M(5, C) by the adjoint action as a diagonal subgroup of Ki. Hence, 





(M(5,C))^„ 
(M(5,C))x,, 



X 

yh 

1 
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x,y e C|, 
Vr(0, 0,0,0). 



Though A = (1,1,1,1) G D(K, Ki^a]): by the preceding computation (in case (gi, ^2, Q's, '?4) = 
(0,0,0,0)) we see that a nonzero element in (M(5, C))i^j^j = W{0, 0,0,0) gives eigenvalue 
-cl = 16 > 14. 

Suppose that A = (1, 1, 2, 0). Then dimcVA = 50. It follows from Lemma llO.ll that (gi, ^2) = 
(1, 1) or (0, 0) and [q^, q^) = (0, 2), (1, 1) or (2, 0). Thus 

Va = (1^(1,1) K t/(o,2)) © iW^l,l) K t/(i,i)) © (1^(1,1) K t/(2,0)) 

© (1^(0,0) K f/{0,2)) © (W^(0,0) K f/{l,l)) © (W^{0,0) K f/(2,0))- 

Here only {qi,q2,q3,qi) = (1,1,1,1) (W^(i,i) ^i,i)) belongs to D{Ki, Kq). and the corre- 
sponding eigenvalue is — cl = 14. On the other hand, the representation of K with highest 
weight A= (1,1,2,0) is A5KAd,^(2)- Set Ai = (pi,p2) = (1,1) e D{Sp{2)). Then 

^A, = = Cei © spanc{e2, 63, e^, e^} = W^(o,o) © 

Using the quaternionic representation 

5p(2) = {X e M(2, H) I X* + X = 0}, 

we chose the following basis of sp(2): 

■= (I 0) ' 



where {i,j,k} denote the unit pure quaternions. 
Set A2 = (P3,P4) = (2,0) e D{Sp{2)). Then 

Va^ = spaucl^i, E2, E3, E^} © spanc{^5, Eq, E7} © span^j^s. Eg, E^} 

= 1^(1,1) © 1^(2,0) © W^(0,2) 

By a direct computation, we get that 

{VAjKo =spanc{e2 (g) + ea © E2 + 64 (g) + es © E4} 
={Va)k^^^ C 1^(1,1) ©f/(i,i). 

Therefore, A = (1,1,2,0) G D{K, K[a\), which gives eigenvalue 14 with multiplicity 1. Simi- 
larly, we can show that A = (2, 0, 1, 1) G D{K, K[a]) which gives eigenvalue 14 with multiplicity 
1. 

Moreover, we observe that 

n{L^^) = dime V(i, 1,2,0) + dime V(2,o,i,i) = 100 

= dim 50(16) - dimSp{2) x Sp{2) = nhk{L^^)- 

From these results we obtain that L^"^ = G i spfi)xSp^^) '^ ^ Qui^) is strictly Hamiltonian stable. 
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10.6. Eigenvalue computation when m > 3. For each 

A = PlVl + + P32/3 H \- Pm+2ym+2 G D{K, Kq) 

with PieZ,Pi>p2,P3>Pi>---> Pm+2 > 0, 

A' = qm + 52^/2 + g32/3 + 94^/4 + g52/5 H h qm+2ym+2 G ^(^^2, i^o), 

with gi G Z, gi > g2 > 0, ga > g4 > 0, gs > ■ ■ ■ > gm+2 > 0, gi = pi, g2 = P2, and 

A" = kiyi + /i;2l/2 + ^3^/3 + ^4Z/4 + /i^Sl/S H \- km+2ym+2 & D{Ki, Kq) 

with ki & Z, ki > for 1 < i < 4, /cs > /cg > ■ ■ ■ > /i;m+2 > 0, /cj = g^ for 5 < j < m + 2, the 
corresponding eigenvalue of —Cl is expressed as follows: 

1 

-Cl = - 2ca + ca' + -ca" 

m+2 

= 2 (J2 P^i + + '^P^ + ^"^I'a + (2m - 2)p4 + ■■■ + 2pm+'^ 

i=l 

(10.2) m+2 

- + + 2g2 + 4g3 + 2g4 + (2m - 4)g5 + ■ ■ ■ + 2g^+2) 
1=1 

^ m+2 

- - (J2 + + 2A;2 + 2k3 + 2A;4 + (2m - 4)A;5 + ■ ■ ■ + 2^:^+2) , 

i=l 

where g^ = ki for 5 < i < m + 2, pi = qi, p2 = q2 and /ci = /C3, /i;2 = /C4. 

Suppose that A = (pi,p2, ■ ■ ■ ,Pm+2) = (2, 2, 0, ■ ■ ■ ,0) G D{K). Then by using the branch- 
ing law of {Sp{2),Sp{l) X Sp{l)) we see that A G D{K,Ko), A' = (gi,g2,-- - ,gm+2) = 
(2, 2, 0, ■ ■ ■ , 0) G D(i^2, /^o) and A" = {k,, A;2, ■ ■ ■ , km+2) = (0, 0, 0, ■ ■ ■ , 0) G D(J^i, i^o)- Hence 
by (110. 2p the corresponding eigenvalue is —cl = 20 < 8m — 2 for m > 3. On the other hand, 
the representation of K with highest weight A = (2, 2, 0, ■ ■ ■ , 0) is a 14- dimensional irreducible 
representation pgyj^^g^^^s) Kll of Sp{2) x Sp{m), where Psymg(c5) is the composition of the natural 
surjective homomorphism Sp{2) — )■ 50(5) and the traceless symmetric product representation 
of S0{5) on Sym2(C5) := {X G M(5; C) \ X' = X,tiX = 0}. Here each A G 50(5) acts on 
SjmliC^) by Sym2(C5) 3X^ AX A' G Symg(C5). So 

Symo(C^) = C ■ (J -1/4)®! (o X') ' ^' ^ Symo(C^)} 
(I* 0) l^eM(l,4;C)} 



Symo(C^) © 



and 



(Symo(C^))50(4) = C ■ (^J "ij " 



Under the natural surjective homomorphism S'p(2)(c SU{A)) — > 5*0(5), the element 
/O 1 \ 

^ ^ Q I ^ Sp{2) corresponds to diag(— 1, 1, —1, —1, —1) G 50(5), denoted by Q'. By a 
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direct computation, we know that (Symo(C^))Q/.50(4) n (Symo(C^))5o(4) = (Symo(C^))5o(4)- 
Thus, 



and moreover. 



(VA=(2,2,0,-,0))ii'o ^ ^ ■ (^0 -^14) ^ ^ 
(Va.= (2,2,0,-,0))/<[„j = C ■ ^ 



This means that A = (2, 2, 0, ■ ■ ■ , 0) G D{K,K^) has muhiphcity 1, which corresponds to 
eigenvalue 20 < 8m — 2. Therefore, C Q8m-2(C) is not Hamiltonian stable. 

From our results of this section we conclude 

Theorem 10.1. The Gauss image L = (5^(1) x%{i)lfspl^^2)yz4 ^ <58m-2(C) (m > 2) zs not 
Hamiltonian stable if and only if m > 3. If m = 2, it is strictly Hamiltonian stable. 

11. The case {U,K) = {E6,U{1) ■ Spin{10)) 

In this case, U = Eq and K = U{1) ■ Spin{10). Then [U, K) is of BC2 type. For the sake of 
completeness, we first settle our notations following [l2], [51], [22] and the references therein. 

11.1. Cayley algebra. Let K be the real Cayley algebra and {cq = 1, Ci, ■ ■ ■ , Cy} the standard 
units of K. They satisfy the following relations (|42]): 



CjCj+l — — Ci+3, Cj+iCj+3 — — Cj+3Ci+i — Cj, 

Q+sCi = — CjCj_|_3 = Cj+1, = — 1 for i G Z7. 

K is a noncommutative and nonassociative normed division algebra with the conjugation 
X I— >■ X and the canonical inner product ( , ) defined respectively by 



7 7 777 

1=1 i=l i=0 i=0 i=0 

We extend the conjugation and the inner product C-linearly to the complexified algebra 
of K and denote them by the same notions x 1— )■ x and ( , ) respectively. 

11.2. Exceptional Jordan algebra. The exceptional Jordan algebra H^iK.) is defined as 
the set 

Hs{K) = {ueMsiK)\u' = u}, 

with the Jordan product 

u o V = -{uv + vu), for u,v ^ H^CK). 
The real dimension of 1/3 (K) is 27 and a typical element 

/ 6 X2 \ 

(11.1) u=\x3 ^2 xi\, ^iGR,XieK 

V X2 Xi ^3 / 

of HsCK) will be denoted by 

U = ^iCi + {262 + ^63 + XiUi + X2U2 + X3M3. 

70 



In H^iK.), we define the trace tr(M) and an inner product {u,v) respectively by 

tr(M) =6 + 6 + 6, {u,v) := tr{uov). 
for eacli u,v ^ H^iK.). Moreover, tlie Freudentlial product u x v is defined by 

u X V := 2 (2"" o V — tY{u)v — tT{v)u + (tr(M)tr(t') — (m, v))!^), 

where I3 is the 3-order identity matrix, and a trilinear form {u, v, w) and the determinant det u 
are defined respectively by 

{u, V, w) = {u,v X w), det u = -{u, u, u). 

Put 

SH^iK) = {ue M3(K)|n* = -u,tr(u) = 0}. 
An element u G SH^{K) of the form 

(11.2) u=\ -X3 Z2 xi , Zi,Xi eK,Zi = -Zi,TjZi = 

\ X2 -Xi Z-i j 

is denoted by 

U = ZiCi + 2:262 + 2:363 + XiUi + X2U2 + X3U3. 

Now we define two injective linear maps R : H^iK.) qI^H^CK)) and D : SH^lK.) — )■ 
Ql^H^iK.)) respectively by 

R{u)v = u o V = -{uv + vu), for m, v e H^^K), 
(11-3) ^ % 

D{u)v = -[u, v] = i^{uv - vu), for u G SH3{K), v G H3{K). 

Denote by 2) and £H the images of D and R in g[(if3(K)). Introduce some subspaces of and 
£H in the following: 

Do = {5gD|5(6,)=0(z = 1,2,3)}, 
Tii ^ {D{xui)\x eK} forz = 1,2,3, 

^ = {i?(^6ei)l6 e R,5^6 = 0}, 

IHi = {i?(xui)|a; G K} forz = 1,2,3. 

Remark that dimSo = 28, dimDi = dim 2)2 = dim 2)3 = 8, dim^Ho = 2 and dim91i = 
dimSK2 = dim 9^3 = 8. Moreover, it is easy to know that T)q is a subalgebra of gl(iJ3(K)) 
generated by the set {D{T^Ziei)\zi G K, = —Zi, T.Zi = 0}. In fact, is isomorphic to the Lie 
algebra 0(8) and its basis can be chosen as {Di r{l < r < 7), -Dj,pg(l < p < g < 7)} for z = 1, 2 
or 3 ([H], [22], [51] )• We now explain in details by using Ise's notions ([22], p.82). Put 

A,r = D{cr{-ej + 6fc)), (1 < z < 3, 1 < r < 7), 

and 

(11-4) A,pg = [A,p,A,,], (l<^<3,l<p,g<7), 
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where {i,j, k} is a cyclic permutation of {1, 2, 3}. Then from 



3 I 



i=l 



we can obtain 



—CrUi, if X = Co 



0, 



if X = Cr 

if X = Cg{q 7^ r) 



J' 



and 



if X 
if X 
if X 



Cr(r < 0, 7^p,g), 



11 



These mean that every -Dj^r, Dipg leave Tj = {xMj|x G K} invariant (1 < « < 3, 1 < g, r < 7) 
and identifying with K, it represents a skew-symmetric matrix with respect to the basis 
{co, Ci, • • • , C7}; namely Dj^^ = -^or — -E'ro and -Dj,pg = -E^p — -Epg, where Epg denotes the 8x8 
matrix with all 0-components except (p, g)-component, 1. Moreover, 

(11-5) [Di^rj Di^pq] = Di p6gr Di g6rp, 

(11.6) [-Djpg, Di^rsl -DipfSgg -\- Di qgdpr -\- Di 'fqdgp ~\~ Di gp6rgy 

where 1 < i < 3 and 1 < p,q,r, s < 7. Particulary, we have 

[-OjjD ^i,pq\ 0, [-Dj pg, -Dj 0, 

if p,q,r,s are all different each other. Denote the real linear space spanned by all Di^r,Di^pq 
{I < p,q,r < 7) by IDj^o- Then all Difi{l < i < 3) are isomorphic to each other, and they are 
isomorphic to the Lie algebra 0(8). We shall use S)o = Si in the next. 
Let 

Hs{Kf := H^iK) + ^/^HsiK) 

be the complexification of H^iK.). Then there are two complex conjugations on H-sCK)^, 
namely, 

Ui + V^U2 = Ui + \/^U2, t{Ui + \/^U2) = Ui - 

where ui,U2 G H^lK.). Then H^^K)^ is canonically identified with 



-lU2, 



Hs{K^) = {ueMs{K^)\u' = u}. 
An element u G HsCK^) of the form f lll.ip . with G C, Xj G K^, is still denoted by 



u = ^lei + ^2^2 + ^363 + XiUi + X2M2 + The standard Hermitian inner product 

H^iK^) is defined by 

{u, v) := {tu, v). 
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)of 



Meanwhile, the complexification SH^CK)^ of SH^iK.) is identified with 

SHsiK"^) = {ue M3(K^)|m* = -M,tr(M) = 0}, 

whose element u of the form (111.21) . with Zi,Xi G K*-', is still denoted by n = ziei + 2262 + 
Z3e3 + xiUi + X2U2 + X3U3. Then D{u) e Qi{H3{K^)) for m e SHsiK'^) and R{u) e QiiH^iK^)) 
for u G H^CK^) can be defined by the same formula as (111.31) . 

11.3. Basic formulas in Zq. 

Lemma 11.1. For v = ^iCi + ^2^2 + ^363 + XiUi + X2U2 + X3U3 G H^iK.^), we have 

+ ^('73 + Vl)x2U2 + ^(^71 + V2)X3U3, 
-P(y^ Ziei)v = ^{Z2XI - XiZ3)ui + ^(2:3X2 - X2Zi)u2 + ^(2:1X3 - X3Z2)U3, 

D{xui)v = {x,Xi){ej - Ck) + ^(^fc - Qxui - ^{xxk)uj + ^{xjx)uk, 

Rixu.)v = {X, x.)(e, + e,) + \{^, + i,)xu, + \xx,u, + \x,xu,, 

where {i,j,k} is a cyclic permutation 0/(1,2,3}. 

The relations (111.41) . (Ill.Sp . (I11.6P and the following list give commutation rules for e^. 
Here, x,y ,Zi € K^, Zj = -Zi for i = 1,2,3, ^^Zi = 0, and 6,6,6 ^ C with Zli6 = 0- In 
formulae (111.71) (111.151) . {i,j,k) is a cyclic permutation of (1,2,3). In formulae (I11.17P and 



(jll.l8|, i = 1,2,3. 






(11.7) 


[R{xUi),R{yUj)] = - 


il/2)Dixyuk), 


(11.8) 


[R{xUi),D{yuj)] = [D{xUi),R{yUj)] = {l/2)R{xy Uk), 


(11.9) 


[D{xUi),D{yuj)] = - 


-{l/2)D{xyuk), 


(11.10) 


[D{xUi),R{yUi)] = {x,y)R{ej - e^). 


(11.11) 


\r(J2 iiei).R{xUi) 


= (l/2)(e,-6)^(a;M.), 


(11.12) 


[R{Y,ii(^i)^D{xui) 


= (l/2)(6-6)^(a;n,), 


(11.13) 


^D(^ziei),D{xUi) 


= {l/2)D{{zjX - xzk)ui), 


(11.14) 


\p{^ziei),R{xUi) 


= {l/2)R{{zjX - xzk)ui), 


(11.15) 


[R{xUi),R{yUi)] = - 


[D{xUi),D{yui)] 



r,,,y + yx-x x + xy-y 

= m—^ — 2 2 — ^)(^^-^^)) 

(11.16) [<,0^^ + DoT ={0}, 

(11.17) [R{xui), [R{xui), R{yui)]] = R{{{x, x)y - (x, y)x)ui), 
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(11.18) [D{xui), [D{xui), D{yui)]] = D{{{x, y)x - (x, x)y)ui). 
Remark that the KiUing-Cartan form B of is given by (|22], p. 88 or [51], p. 74) 

(11.19) B{u,v) = Aii{uv), 
for each u,v e C. Q{{H^iK)^). 

11.4. Realization of Eq/{U{\) ■ Spin{10)). We recall and combine the settings given in [51] 
and [2^. It is known that is defined to be the automorphism group of the Jordan algebra 

Fi := {a G GL{H^{K)) \ a{u o v) = au o av} 

= {a G GL{H^{)^)) I det(aM) = det m, (aw, aw) = {u,v)}. 

Its Lie algebra f4 is thus given by 

f4 := {5 G Q{{H'i(K)) I 5{u ov) = 5u o V + u o 5v}, 

which is isomorphic to D = 2'o + S)i+!l)2 + S)3. We are interested in the following two 
subgroups of F4: 

(F4)e^ := {a G F4 I aei = ei} = Spin{9), 
(-^4)61,62,63 := {a G F4 I aei = Ci {i = 1,2,3)} = Spin{8). 

Note that the Lie algebra of (-^4)61,62, 63 is So- 
The groups E^ and Eq are defined by 

E^ := {a G GLdHsiKf) \ det(au) = det(u)}, 

Eq := {a G GLc(-f^3(K)^) | det(aM) = detw, {au,av) = {u,v)}, 

respectively. Hence F4 is a subgroup of Eq. The Lie algebras of E^ and Eq are given respec- 
tively by 

e6'':= {0 G 0[c(^3(K)^) I {(Pu,u,u) = 0}, 

eg := {</> G 0[c(i?3(K)'^) | (0n, n, u) = 0, {(f)u, v) + (u, (j)v) = 0}. 

It can be shown ([51], p. 68) that any element G is uniquely expressed as 

= 5 + ?, 5gS)^, .jG?^'^', 

where and denote the complexifications of D and respectively. So we get the so- 
called Chevalley-Schafer model ([11]) of e^: = + as a subalgebra of qI{Hs{K)^). 
The inclusion : C qIIH^CK)^) is a 27-dimensional irreducible representation of e^. Fur- 
thermore, any element G eg is uniquely expressed as 



= 5 + V-U, 5g2), <;G9^. 

Equivalently, eg := D + a/^*K. 

Consider a C-linear transformation cr of H^{K.)^ defined by 

^1 -X3 -X2 
-3:2 Xi ^3 
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X3 


X2 ] 










Xi 


H 




[ X2 


Xi 







Then a ^ Eq and o"^ = 1. cr induces an involutive automorphism of E^hy a ^ aaa, which we 
also still denote it by cr. In order to investigate the subgroup {E^Y of fixed points of a, 

(11.20) {EqY = {aeEQ\aa = a}, 
consider two subgroups 

(£"6)61 = {a G i?6 I aci = ei} = Spin{lQ) 

and 

(11.21) f/(l) = {m e GLc{H,{Kf) I e = e^''/\te R}, 
where (j){e) := exp{t^/^R{2el - ea - 63)) G GLc(i/3(K)<^) and 

/ ^1 X3 X2 \ / e% 6X3 0X2 \ 

(11.22) m X3 6 a;i = ^3 ^-'6 ^-'xi . 

\X2 X, J \ 6x2 0~'x, 6-% J 

Here the subgroups U{1) and Spin{10) of (-E'e)'^ are elementwise commutative. Define a map- 
ping 

p:k = U{1) X Spin{10) 3 {6, a) h-^ (j){6)a eK= (E)", 
which is a surjective Lie group homomorphism. Since 

U{1) n 5pm(10) = {1 = 0(1), 0(-l), 0(v^), 0(-v^)}, 

we have Ker(p) = {(1, 0(1)), (-1, 0(-l)), (v^, 0(-v^)), (-v^, 0(v^))}, which is iso- 
morphic to Z4. Thus 

K = {EqY = K/Z4 = (f/(l) X ^pm(10))/Z4, 
and U/K = Eq/{U{1) ■ S'pm(lO)). Correspondingly, 

i = (ee)^ = {0 e ee I (t*0 = 0} 
= (e6)ei + Rv^i?(2ei - 62 - 63). 
Since for any G Ce there exist u G 5'iJ3(K) and v G if3(K) such that 

(Pe^ = D{u){ei) + V^Riv)iei), 
it holds that 0ei = if and only if 

u = ZiCi + 2:262 + 2363 + aiUi e 5'iJ3(K), V = ^2^2 + ^363 + XiUi G i/3(K), 
where ai, xi G K, ,^2, ■Cs ^ R- with ^2 + = 0. Hence 

(e6)ei := {0 G Cg I 0ei = 0} 

= Do + Di + Rv^i?(e2 - 63) + v^D^i 
^ 0(10) 

Therefore, we have the Cartan decomposition of a compact simple Lie algebra u = eg of type 
EIII: 

u = eg = D + v^9^, 

t = (eg), = Do + Si + v^lHo + v^D^i, 

p = (e)_, = ©2 + 2)3 + v^9^2 + v^^3, 
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where t is isomorphic to u(l) + o(10), 

[fi, !] = S)o + 2)i + V^RR{e2 - eg) + v^D^i = {ce)^, 
is isomorphic to o(10) and the center of t is spanned by 

Z = v^i?(2ei-e2-e3). 

On the other hand, a compact Hermitian sjTumetric space of type EIII can be defined by 
(P p74-75]) 

EIII = {ue Hs{K)^ \ uxu = 0,u^ 0}/C* C P{H3{K)^), 

which is considered as a compact complex submanifold embedded in a complex projective 
space CP^^. Since Eq acts transitively on EIII and the isotropy subgroup of at o = [ci] 
is {EqY, we know that EIII = Eq/{EqY = Eq/{U{1) ■ Spin{lQ)). The tangent vector space 
ToiU / K) at o can be identified with a vector subspace 

ro(EIII) = {ue HsiKf I n X ei = 0, {u, d) = 0} 
= {X2U2 + X3U3 I X2, X3 e K^}. 

The differential of the natural projection p : U = Eq ^ U/K = EIII induces a linear 
isomorphism : p — To(EIII). Then p*(</)) = 0(ei) and 



P* (2{D{X2U2) - D{x3U3)) + 2V^{R{x'^U2) + Rix'^u-s)) 

(11. 23 ) 

= {X2 + \/^x'2)u2 + (X3 + A/^a^g)^. 

11.5. Restricted root systems of EIII. Define Hi, H2 G p by 

Hi = DU2 + \f^R{c4U2)-, 
H2 = Du2 - y/^R{c4U2). 

Then by ffTTTUl) . [Hi,H2] = 0. Hence 

(11.24) a = = ^iHi + 6^^216, 6 G R} 

is a maximal abelian subalgebra in p. Remark that this maximal abelian subalgebra a is 
different from the one given by M. Ise and used in [12]. Then by direct computations using 
flll.4p -( [11.18p . we get the following restricted root system decomposition of i and p: 

t = ^0 + ^26 + + %+6 + + % + 

p = a + P25, + p26 + + + Pa + P6 , 



where 



to = {X G ! I [X,H] = for each H G a}, 

= spanj^{A/^i?(ei - 2e2 + 63)} + spanR{-L'i,4 + L'1,12, P'1,12 + P'l.se, 

-Dl,36 + -Dl,577 + Di 24, —D12 — Di i4, — -Dl,3 + -Dl,467 "-^1,5 — -Dl,47; 

— -Dl,6 + -Dl,34, —Dij + -Dl,45) -Dl,l3 — -Dl,26) -Dl,l5 + -Dl,27; -Dl,l6 + -Dl,23; 

-Dl,17 — -Dl,25; -Dl,35 — Di qj, Di ^-j — -Dl^se}, 

76 



% = spanR{^(-iPi,4 - 0)1,12 



Oi,36 - Oi, 



57) 



-li?(e3-ei)}, 



spani^{^(Oi,4 + Oi,i2 


~ -Dl,36 ■ 


+ A,57) 


+ V^i?(e3-ei)}, 


= spanR{-Oi,i 


— -Di 24 


- ^1,37 


~ -Di 56 = 2D2,i, 


- Oi,2 + Oi,i4 - 


' Dl,35 - 


-Dl,67 = 


2/^2,2, 


- Oi,3 - Oi,46 + 


-^1,17 + 


' -Dl,25 = 


2/^2,3, 


- Oi,5 + Oi,47 + 


' -Dl,l6 — 


Di,23 = 


2/^2,5, 


— Oi^e ~ -Oi,34 - 


- ^1,15 + 


' -Dl,27 = 


2/^2,6, 


~ -Dl,7 — -Di 45 - 


■ /^1,13 - 


" -Di,26 = 


2/^2,7}, 






T -'->'1,37 


1" -^1,56 — 2L>2^24:^ 


- Oi,2 + Oi,i4 + 


^1,35 + 


-Dl,67 = 


2-02,14, 


— Di;3 — Di^4Q — 


^1,25 - 


^1,17 = 


— 2-02,46; 


- Oi,5 + Oi,47 - 


^1,16 + 


^1,23 = 


2-02,47; 


- Oi,6 - Oi,34 + 


^1,15 - 


-Dl,27 = 


^2-02,34, 


- Oi,7 - Oi,45 + 


^1,13 + 


-Dl,26 = 


-2/^2,45}, 



Ig, = spanii{0'(xiMi) + ^f^R{yiUi), (xi, yi) = (1, C4), (ci, -C2), (c2, Ci), 

(C3, Ce), (C4, -1), (C5, -C7), (C6, -C3), (C7, C5)}, 

% = spani^{0)(a;ini) + y/^R{yiUi), (xi, yi) = (1, -C4), (ci, C2), (c2, -Ci), 

(C3, -Ce), (C4, 1), (C5, C7), (C6, C3), (C7, -C5)}, 

psa = spani^{0'(c4n2) - V^Ru2}, 

P26 = spanj^{0)(c4U2) + y/^Ru2}, 
p5,+g2 = spanj^{0)(QU2), « = 1, 2, 3, 5, 6, 7}, 
PC1-C2 = spanii{v/^i?(ciM2), « = 1, 2, 3, 5, 6, 7}, 

p^, = spanii{0'(x3M3) + y/-lR{y3U3), {xs, ys) = (1, C4), (ci, C2), (c2, Ci), 

(C3, Ce), (C4, -1), (C5, -C7), (C6, -C3), (C7, C5)} 

P52 = spanR{0'(x3M3) + y/-lR{y3U3), (xs.ys) = (1, -C4), (ci, -C2), (c2,Ci), 

(C3, Ce), (C4, 1), (C5, -C7), (C6, -C3), (C7, C5)}. 

Thus we see that 

10 = io + c(«o) = «o + Rv^i?(ei - 262 + 63) = so(6) + R, 

11 := to + ^2^1 + ^2^2 

= !'o + Rv^i?(ei - 262 + 63) + R(/^l,4 + /^l,12 - ^1,36 + ^1,57) 
+ Rv^i?(63 - 61) 

= so(6) + R + R + R, 
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= So + Ry/^R{ei - 262 + eg) + RV^Rie^ - ei) 

= So + RV^R{e2 - e-s) + Rv^i?(2ei - ea - eg) 
^so(8) + R + R, 

! := «2 + «6 + ^2 = 2)o + v^^Ho + Di + v^^Hi 
= (So + Si + v^9^i + Rv^i?(e2 - es)) + R^^/?(2ei - 62 
= t' + c{t) ^so(lO) + R. 

Correspondingly, consider the subgroup 

= f/(l) X Spin{2) X Spin{8) C K = U{1) x Spin{10), 
where U{1) is given by flll.2ip . Spin{2) C S'pm(lO) = (-E'e)^ is generated by 
a23(i) := exp(tv^-R(e2 - 63)) : 

"X2\ 





xz 


X2^ 








Xl 




\X2 









4i e 2 X3 e 

_ 

e 2 X3 e 

_ _ 

e 



Xl 

— X2 Xl e^*^^3/ 



and Spin{8) = (-E'6)ei,e2,e3 whose Lie algebra is just So- Therefore, 

Spin{2) n 5p2n(8) = {«23(t) | e*^ = 1} = {a23(0), ^23(271)}. 
Then the natural projection 

P2 : Spin{2) x Spin{8) -> 



has a kernel 



(a23(i),/3) ^ a23(i)/3 

kerp2 = {(a23(t), a23(t)^') I t = 2/c7r, k e Z} 

= {(«23(0),«23(0)),(a23(2vr),a23(27r))} = Z2. 



Hence K!^ ^ (5pm(2) x Spin{8))/Z2. 
On the other hand, we also have 



K2 = S^ X Spin{2) X Spin{8) 



where 5*^ is generated by 



exp(tv^i?(ei - 262 + 63)) : 





X3 


X2^ 




Xs 




Xl 




\X2 


Xl 







/ gtv^^j^ g '^X3 e*^^X2 ^ 



e 2 X3 e" 



-2tV-l 



6 e 2 Xl 



Xl e 
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Spin{2) C is generated by 

a3i(t) := exp(tv^i?(e3 - ei)) : 

^1 X3 XaX / e"*^^i e~^X3 X2 \ 
2^3 « I I— )• e 2 X3 42 e 2 xi • 

and Spin{8) = (-E'6)ei, 62,63- Here Spin{2) x Spin{8) C (-E'6)e2 — 5'pm(10). Similarly, here 

^p^n(2) n SptniS) = {asiit) \ e*^^ = 1} = {a3i(0), «3i(27r)}. 
Then the natural projection 

P2 : Spin{2) x Spin{8) K2 
(a3i(t),/3) ^ 031 

has a kernel 

kerp'2 = {(a3i(t),a3i(t)~^) I t = 2k7r,k G Z} 

= {(«3i(0),a3i(0)),(a3i(2vr),a3i(27r))} ^ Z2. 

Thus, 

= {S^ X (5pm(2) ■ Spin{8)))/Z4, 
Spin{2) ■ Spin{8) = {Spin{2) x Spin{8))/Z2. 
Furthermore, we have 

Spin{8) D Spin{2) ■ Spin{6) = {Spin{2) x ^pm(6))/Z2, 

where 

Spin{8) = {(ai,a2,a3) e SO{K) x 50(K) x 50(K) | 

{aix){a2y) = asixy) for each x,y E K} 

acts on iJ3(K) by 

(6 2:3 X2\ / 6 033:3 "2^ 
^3 6 ^1 •= I ^2 
X2 xi i^J \a2X2 oIxT ^3 

Spin{2) := {(ai,a2,«3) G Spin{8) \ a2(cj) = Q, if ^ 7^ 0, 4} 
is generated by Di^4 + -Di,i2 — -Di.se + -^1,57 and 

Spin{6) := {(ai,a2,a3) G Spin{8) \ a2(l) = I,a2(c4) = C4} 

is generated by Fq. Notice 

^pm(2) n Spin{Q) = {(Id, Id, Id), (-Id, Id, -Id)}, 

we see that Z2 = {((Id, Id, Id), (Id, Id, Id)), ((-Id, Id, -Id), (-Id, Id, -Id))}. Thus, the 
nected compact Lie subgroup Ki of K generated by is 

Ki = {S^ X {Spin{2) ■ {Spin{2) ■ Spin{6))))/Z^. 

Moreover, 

n Spin{Q) = {(Id, Id, Id), (-Id, Id, -Id)}, 
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hence the connected compact Lie group Kq of K generated by is 

Ko = {S' X Spin{6))/Z2, 
where Z2 = {((Id, Id, Id), (Id, Id, Id)), ((-Id, Id, -Id), (-Id, Id, -Id))}. 

11.6. Isotropy representation of [Eq, U (1) ■ ^^^^(lO)). Via the linear isomorphism : p — )■ 
To(EIII) given by flll.23p . we can describe the isotropy representation of (E'e, U{1) ■ Spin{10)). 

Lemma 11.2. (1) For each a E K and each C, E p, 

p.(Ad(a)0 = (Ad(a)O(ei) = {a o ^ o a-'){e,). 

(2) For each T G t and each ^ E p, 

p,(ad(r)0=P*([T,e]) = ([T,e])(ei). 

The restriction {pk,V = H^CK^)) of Chevally-Schafer's representation (p, iJ3(K*^)) of Eq 
to K can be decomposed into three irreducible representations 

{pK, V) = (pi, Vi) © (p2, V2) © (P3, V3), 

where Vi, V2 and V3 are given as follows: 
V, = {^ei I e e C}, 

V2 = {H,{K^))^^ = {X2U2 + XSUS I X2,X3 G K^} ^T,(EIII), 

V3 = H2{K^) = {^262 + ^es + x,ui I xi e K^, ^2, 6 e C}, 

and Vi © V3 = {Hs(K.^))(j. pi is a scalar representation, the restriction of p2 to Spin{10) is 
equivalent to one of the half-spin representations of Spin{10, C), called Af^, and the restriction 
of Pa to Spin{10) is equivalent to the standard representation of Spin{10, C). 

Now we discuss the linear isotropy action of an element (j){6) = exp{t\/—lR{2ei — 62 — 63)) : 
H3{K^) H-s^K*^) generating the center f/(l) of K on both p and V2 = (/f3(K*^))_^, which 
are identified with To(EIII). 

Using the formula (111.221) and Lemma 111.21 we compute 

p,{Ad{<f){e))D{x2U2)) = e~^p,{D{x2U2))^ 
p,iAd{(P{9))Rix2U2)) = 9-'p,iRix2U2)), 
p,{Ad{(P{e))D{x3U3)) = 9~'p4D{x3U3)), 
p,{Ad{(t){e))R{x;U;)) = 9-'p,{R{x3U3)). 

On the other hand, the tangent vector space To(EIII) at o = [ei] G EIII) C P^H-siK.)^) is 
identified with the vector subspace V2 = {H^CK^))^^, which is a horizontal vector subspace 
at a point ei under the Hopf fibration H-sCK)^ D 5'^'^(1) — ?■ P(if3(K)*"). By the formula 
(111.221) we see that a vector X2U2 + X3U3 G {H-sCK^))^^ at a point ei in a vector space H^iK.)^ 
representing a tangent vector of EIII at o = [ei] is moved by the linear action of (j){6) to a 
vector 9X2U2 + OX3U3 G (H^iK.^))^^ at O'^Ci. Thus its corresponding tangent vector of EIII at 
= [ei] must be 9~'^{9x2U2 + Ox^u^) = 9~^{x2U2 + X3U3) G V2 = (if3(K^))_o- at ei. Hence the 
linear isotropy action of (j){6) on V2 = (iJ3(K*^))_cr is given by the multiplication by on 
V2 = (if3(K^))-.. 

Therefore the linear isotropy representation of {Eq, U{1) ■ Spin{10)) is (p3 ©c A^q)r. 
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11.7. The subgroup K\^a]- The maximal abehan subspace a of p is described as follows: 
and 

(11.25) p,{a) = R(l + v^C4)m2 © R(l - \^Ci)u2. 

We will use the map (f : Sp{A) — > Eq given by Yokota (^I]) and the known results for 
(5*^(4), Sp{2) X 5*^(2)) case to find a generator of ^[0] here. 

The Cayley algebra K naturally contains the field H of quaternions as 

H = {xo + X2C2 + X3C3 + 0:505 1 e R}. 

Any element a; e K can be expressed by 

X = Xo + XiCi + X2C2 + X3C3 + X4C4 + X5C5 + XqCq + X7C7 
= {Xo + X2C2 + X3C3 + X5C5) + {X4 + X1C2 + XqC3 - X7C5)C4 

=: m + ae e H © He = K, 

where m := Xq + X2C2 + X3C3 + X5C5 G H, a := X4 + X1C2 + XqC^, — XjC^ G H and e := C4. In 
H © He, we define a multiplication by 

(m + ae){n + he) = {mn — ha) + (an + hm)e. 

More explicitly, 

{ae)n = (an)e, m{he) = {hm)e, (ae)(6e) = —ha. 
We can also define a conjugation and an R-linear transformation 7 on H © He respectively by 

m + ae = rh — ae, 7(m + ae) = m — ae. 

Thus 7 G G2 = {a £ Isor(K) | a{xy) = a{x)a{y)}. Consider an R-linear transformation of 
HsiK.), denoted still by 7, defined by 

/ ^1 X3 X2\ / ^1 IX-i 7X^ 

7 6 Xi := 7^ 6 72^1 

\X2 xi j \ 7x2 7x1 ^3 

for Xi G K (z = 1,2,3). Thus 7 G F4 = {a G Iso^^H^iK)) \ a{X oY) = a{X) o a{Y)}. Any 
element 

(6 ^2 \ f ^1 rh2 \ / a3e -a2e 

X3 ^2 xi \ = I rfis ^2 rrii \ + \ -a3e aie 
X2 xi ^3 J \ m2 nil ^3 J \ a2e -aie 

of 7/3 (K), where Xj = mj + a^e G H © He = K and G R, can be identified with the element 

m3 fri2 

6 "^1 I + (ai,a2,a3) 




m2 mi ^3 



in iJ3(H) © H^. Hereafter, there exists an identification H3{K) = iJ3(H) © H^. 

Let the C-linear mapping 7 : Hs^K^) — )■ H3(K^) be the complexification of 7 G G2 C -F4. 
Then '-f & Eq and 7^ = 1. Recall that r is the complex conjugation of H3{'K^) with respect 
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to HsiK.). Consider an involutive complex conjugate linear transformation r7 of Hs(K^) and 
the following subgroup {E^y^ of Eq. 

{EqY^ = {a E Eq \ T'ya = ar'y}. 

Correspondingly, H^CK^) can be decomposed into the following two R- vector subspaces: 



where 



{Hs{K^)),, := {X e Hs{K^) \ rjX = X} 

ms m2 \ / a^e -a2e^ 

{{ rfis ^2 mi + -flse aie | | e R, m^, e H} 

^2 rhi ^3 J y a2e -Oic 




{X e H^iK^) I T-fX = -X} 



C.1 rh2 \ / 036 -a2e 

^3 6 "^1 + -«3e aie \ \ e R, mi,ai e H} 
^2 rhi ^3 I \ 026 -aie 



3 



-li7,fH)©H 



In particular, HsiK"^) = ((//3(K'^)),^)'^. 

Let -ff4(H)o := {P G -f^4(H) | trP = 0}. Define a C-linear isomorphism g : if3(K*^) 
if3(H^) © (H=^)^ ^ i^4(H)o^ by 

(?(M + a) := 
for M + a G 7/3 (K*^). Then we have 



itr(M) \ 
v^a* M - kr(M)I J ' 



(7((i/3(K^))r7) = ^4(H)o, 

The mapping ip : 5p(4) — y {EqY^ C ^e, defined by (f{A)X := g-\A{gX)A*) for each 
X G if3(K'"), is a surjective Lie group homomorphism and KeT{if) = {1, —1} = Z2. Therefore 
we obtain 

Sp{4)/Z2 = {E,y\ 

Consider R-vector subspaces (7^3 (K^))^^,^, (iJ3(K^))^^ „^ of (iJ3(K^))^^ and (iJ3(K^))_^^,^, 
(iir3(K*-'))„^^ of (i/3(K*^))_^^, which are eigenspaces of a, respectively given by 

{H,{K^)),.,^ = {Xe H,{K^)\ r-fX = X,aX = X} 

^0 



-aie 
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! 




nil 






nil 







(i/3(K^))r7,-<x = {Xe i/3(K^)| T^X = X,aX = -X] 



7713 7712 

={ I m3 

m2 



a-^e —026^ 
-1 I -036 
026 



m2, 7773,02,03 e H}, 



(i/3(K^))-r7,a = e ^3(K^)| r7X = -X,aX = X} 








0^ 









! 




77ii 












77ii 






^0 


— aiG 



(i/3(K^))--.7,- = e H^{K.^)\ r^X = -X,aX = -X} 



7773 7772 



a^e —026 



{V^ I ^^3 I + I -a^e 

026 



7722,77i3,a2,a3 ^ H}. 



^7772 

Thus we have the following decompositions 

(^3(K^)), 



(iJ3(K^))r7,^ © (i73(K^))-r^,., 



{HsiK^))^a = (i73(K^))r7,-.©(i^3(K^))-r7,-.. 

Note that the images of {H-s(K.^))r-y,a and {H3{'K^))r-y,^a of the mapping g defined above 
can be expressed explicitly as follows: 



^?((iJ3(K^)).7,- 



/|(6 + 6 + e3) 

-ai i(6-6-6) 



v 
















K-ei + ^-Cs) mi 



777i 



6,6,6 e R,ai,77ii G H}, 



^7((if3(K^))..,-.) ={ 



/ 








— 0-2 












7773 


7772 




-0.2 


7713 








V 


-03 


7712 





/ 



|(-6-6 + 6)/ 



02,03,7772,7773 e H}. 



For any element A G Sp(2) x Sp(2) C 5*^(4), we can check that </)(yl)cr = a(f{A), hence 
(p{A) G (-Ee)'^ and we have 

: Sp{2) X 5p(2) ^ (^e)"^'" C {Eg)" = f/(l) ■ 5pm(10). 

Next, the restriction of ip to the subgroup S'p(l) x Sp{l) x 5*^(1) x Sp{l) gives 

^ : 5j9(l) X Sp{l) X X Sp{l) — >{a G Eg I «(ei) = (i = 1,2,3)} 

^5pm(8). 

And the group Sp{l) x Sp{l) can be considered as the diagonal subgroup of Sp{l) x Sp{l) x 
S'p(l) X 5*^(1), namely, each (a, 6) G 5*^(1) x S'p(l) corresponds to (a, fe, a, 6) G ^^(l) x 5*^7(1) x 
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Sp{l) X Sp{l). Thus the restriction of ip to Sp{l) x Sp{l) is mapped to a subgroup Kq = 
■ Spin{6) of K = = U{1) ■ Spin{10). In fact, for a 2- dimensional R-vector subspace 



(0 





02 


o\ 











7712 


0-2 











^0 


m2 





0/ 



a2,m2eR}C(7((i/3(K^)) 



r7, — CT 7 1 



it follows from 



/ a 





o\ 


/o 





02 


o\ 




(a* 








o\ 





6 














7712 







6* 











a 





0-2 



















0* 










V 




7n2 

















h*j 


/o 





02 


o\ 

























m2 
















(32 



























77l2 





0^ 

















that a corresponds to the subspace 
{ 



jn2 



7n2 — y—la2G 



/^02e 



m2,02GR}c {H;{K)^] 



T^^ — CT'! 



which corresponds to the image p*(a) of the maximal abelian subspace a of p under the linear 
isomorphism p,, given by ( ]11.25p . It implies that ip maps the subgroup Kq = Sp{l) x Sp{l) for 
the exceptional symmetric space {Eq, Sp{4:) /Z2) of type EI to the subgroup Kq = ■ Spi7i{6) 
of the exceptional symmetric space {Eq, U{1) ■ Spi7i{10)) of type EIII. 
Recall that 



k :-- 



(0 


1 





o\ 


1 




















-1 


^0 





1 


0^ 



G J^[a] = (Spil) X Sp{l)) ■ Z4 



is a generator of Z4. Its adjoint actions on g{{H3(K^))r.y^a) and 5f((i73(K^))T-^^_o-) are given 
in the following: 

+ 6 + 6 



k 



2VSi I I s3j 

— Oi 






V 

V 



-Ol 






-Ol 

2 ('Ci — {2 — 'Ca 



— Ol 

1(6 + 6 + 6) 








K-6 + 6-6 

mi 




|(-6-6 + 6) 



-mi 






mi 




—mi 

4(-6 + 6 



6)/ 



6)/ 
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/ —02 — flsX 

m3 Th2 

-0,2 rh^ 

y-as m2 y 



/ 



-m2 as 

\ rhs -0,2 



-Th2 nis \ 

as —a2 


y 



Taking {Hs{K^)\^ = {Hs{K^)\^^^ © {Hs{K^))r^,^^ and Hs{K^) = {{Hs{K^)U)^ into 
account, together with the above computation, we know that any element 



6 X2 

X3 6 

X2 Xi ^3 




.^1 ms + y/^a^e rh2 - \/^a2e 

Tase ^3 mi + ^/-[ale 

la2e nil — \/—laie ,^3 



in HsiK.*-^) is mapped by the adjoint action of k up to isomorphism to the element 

^1 03 - y/-[mse -a2 - y/^rh2e 

as + ^/^mse -^2 -rhi + ^/-laie 

—(22 + a/— Tm2e —mi — V— lo-ie —^3 

6 A/^(-v^a3 - ?Ti3e) - 

v^( - V^as + mse) -^2 
— V— 1(— V— la2 — ^26) —(mi + Itiie) 

/ ^1 a;3 X2 \ 
= a23(vr) o (ai,a2,«3)( ^3 6 xi ), 

\ 3:2 xi ^3 y 

where q;i,«25«3 ^ 5'0(K) = 5*0(8) are defined by 



/^(-A/^a2 + m2e) 
-(mi + ^/^a^) 

-^3 



^11.26) 



ai(mi + flie) 
a2(m2 + 026) 
a3(m3 + ase) 



-{m.i - flie), 
-a2 - rh2e, 
-as - mse. 



tt3(('^i + aie)(m2 + a2e)). 



-Ieu2, 



By simple computation, we know ai(mi + aie) a2{m,2 + a2e) 
Hence, (ai,a2,Q!3) G Spin{S). Notice that 

a23{n){ai,a2,as){u2) = a23(«2(^i2)) = a23(7r)(-en2) = ^ 
a23(7r)(ai,a2,a3)(v/^en2) = a23(7r)(a2(-v^en2)) = a23(7r)(v^^i2) = -M2- 
It implies that 

a23(7r)(ai, 02,03) G 5pm(2) • Spin{8) C (f/(l) x {Spm{2) ■ Spin{8)))/Zi = K2 

induces an isometry of the maximal abelian subspace a of order 4 which is a 7r/2-rotation of 
a, we obtain 



a23(7r)(ai,a2,a3) G 



and it is a generator of K^^jK( 



= ■^4- 
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11.8. Description of the Casimir operator. Define {u,v)u '■= —tT{uv) for each m, w G ee C 
0[(if3(K)^). Now the restricted root system is S+(f/, K) = {2^i, 2^2, 6 + 6, 6-6, 6, 6} and 



-1R{C4U2)). 



With respect to ( , the lengths of the restricted roots are given by 



l7ll^ 



1 1 1 
- , - or — . 
3 6 12 



Then the Casimir operator Cl with respect to the induced metric G*9q'^q(c) expressed 
as 

Cl = 12Ck/Ko ~ ^dxi/Ko ~ ^Cki/Koi 

where Ck/Ko^ Ck2/Ko and Ck^/Kq are the Casimir operators of homogeneous spaces K/Kq, 
K2/KQ and Ki/Kq with respect to the K -invariant metric induced from the metric ( , of 

Eq. 

11.9. Descriptions of D{K), D{K2), D{Ki) and D{Ko). A maximal torus of Spin{10) 
can be given by 

= {i = (cos 61 — 6162 sin 9i) ■ (cos 62 — 6364 sin 62) ■ (cos 6*3 — c^cq sin 6*3) 
■ (cos 64 — 6768 sin ^4) ■ (cos 9^ — egCio sin ^5) | 6'j G R (i = 1, 2, 3, 4,5)}. 

Under the standard universal Z2-covering map p : Spin{10) — )■ 5*0(10) defined by 

(p(a))x := a ■ x ■ *a G C C/(R^°) 

for each a G Spin{10) and each x G R^°, an element of the maximal torus of Spin{10) is 
mapped to an element in the maximal torus of 5*0(10), namely, 

3 (cos6'i — 6162 sin 6^1) ■ (cos 6^2 — 6364 sin 6'2) ■ (cos 6^3 — e5e6sin6'3) 

■ (cos 6*4 — 6768 sin 6*4) ■ (cos 9^ — egCio sin ^5) 

//cos 2^1 -sin2^i\ ^ \ 

I sin 2^1 cos 2^1 ' 



v 

















COS 29^ — sin 26'? 



G 



^sin2^5 cos26'5 J J 

Hence, we have the exponential map as follows: 

exp : t =t = {(^1, 92, 93, 9,, 9,) | G R (z = 1, 2, 3, 4, 5)} 



f ={ (cos (9^/2) - 6162 sin (^1/2)) ■ (cos (^2/2) - 6364 sin (^2/2)) 

■ (cos (^3/2) - 6566 sin (^3/2)) ■ (cos (^4/2) - 6768 sin (^4/2)) 

■(cos(^5/2)-e9eiosin(^5/2)) 

I G R (i = 1,2,3,4,5)} C ^pm(lO). 
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Thus 

r(^pm(10)) = {e = (^1, ^2, ^3, ^4, ^5) e t I exp(0 = e} 

5 

={e = 271 (fci, A;2, fcs, A;4, ^5) | fc^ G Z (z = 1, 2, 3, 4, 5), ^ A;, G 2Z} c r(^O(10)). 

j=i 

Denote by ?/j (z = 1, ■ ■ ■ , 5) a linear functional t/j : t 9 t t— ?■ G R. Then 
D{Spin{l{])) = {A = piyi + p2y2 + J^ays + ^4^4 + Ps^/s G t* 

I (Pi, ■ ■ ■ ,^5) G + 5(1, 1, 1, 1, 1), where e = or ^, 
Pi>'P2>'Pz>PA> bsl} 3 /^(5O(10)). 
A maximal torus Tk oi K = (f/(l) x S'pm(10))/Z4 can be given as follows: 

T/^ =|(e^ (cosy - eie2smy)(cosy - 6364 smy) 

/ ^3 . 6^4 . 6^4 6^5 • ^5xx 

(cos — - 6566 sm— )(cos— - 6768 sm— )(cos— - egCiosm— )) 
I ^07 ■ ■ ■ 5 ^5 G R}/Z4, 

where to = 2^o, = ^1, U{1) = {exp{to^/^R{2ei - 62 - 63)) | to G R}, 5pm(2) 
{exp(tiA/^i?(e2 — 63)) I ti G R} and 



Z4 := {(1, 1), (-1, -1), (V^, -6162 ■ ■ ■ eio), (-V^, 6162 ■ ■ ■ eio)}. 
The corresponding maximal abelian subalgebra I of £ is 

t = {(^0, 01, O2, 9s, ^4, ^5) I G R (z = 0, 1, 2, 3, 4, 5)}. 



Then 



T{K) ={{ = 27r(^, h, k2, h, h, h) + 7r£(^, 1, 1, 1, 1, 1) 

5 

I ko, ki, /c2, ks, k^, /cs G Z, e = or 1, ^k^e 2Z}, 

0=0 



D{K) =D{{U{1) X 5pm(10))/Z4) 

={A = poyo + piyi + ^2^2 + PsVs + PaVa + G t* 

^Po + Pi + P2 + P3 + P4 + P5 G 2Z, po G Z, 

{Pi,P2,P3,P4,P5) G Z^ + £:(!, 1, 1, 1, 1), e = or ^, 
Pi > P2 > J53 > p4 > IpsI }. 
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Since T/^- is also a maximal torus of = {U{l)x{Spin{2)-Spin{8)))/Z4 C K, T{K2) = T{K) 
and 

D{K2) =D{{U{1) X Spin{2) ■ Spin{8))/Zi) 

={A = po2/o + pivi + + pm + pm + ^5^/5 e t* I 
^po + Pi + P2 + P3 + P4 + P5 e 2Z, po e z, 

(pi,P2,P3,P4,P5) e Z^ + 1, 1, 1, 1), 5 = or ^, 

P2>P3>P4> bsl }• 

On the other hand, = (5'^ x (Spin{2) ■ Spin{8)))/Z4, where 

5^ = {exp{ioV^R{-ei + 262 - 63)) | to G R}, 
5pzr2(2) = {exp{iiV^R{e3 - Ci)) | ti E R} 
and here Spin{2) ■ Spin{S) C (-E'6)e2 — Spin{10). Since 

exp(tov^i?(2ei - 62 - 63)) ■ exp(tiv^-R(e2 - 63)) 

= exp(- ^° ^ ^^ y/^R{-ei + 262 - 63)) ■ exp(- ^^°^ A/^^(e3 - ei)), 

one can take = — ^"2^^ ' ^1 ~ _3tu_Ki g^^j-^ ^j-^g^^ ^]-^g maximal torus = TV of K2 can also 
be described as 

Tk2 = =Tk = {t = [e"^ °, (cos — - 6162 sm y)(cos — - 6364 sm — ) 

/ ^3 . 6^3 6*4 . 6*4 w • ^5xx 

(cos — - 6566 sm y)(cos — - 6763 sm — )(cos — - CgCio sm — )) 
I 9o, - ■ ■ , 6*5 G R}/Z4, 

where 9o = to/2, 9i = ti. Taking account of the triality of Spin{8) = (-E'6)ei,e2,e3 C (-^6)61 — 
{Eq)^^ = S'pm(lO), we choose a new basis jji : t 9i for t* satisfying 

11. 1.1, 
?/o = --?/o + ^2/1, = -3?/o - -yi, 1/2 := -(y2 + y3 + Z/4 + Z/5), 

^3 := ^(2/2 + ?/3 - ^4 - ys), ^4 := ^(2/2 - 2/3 + 2/4 - 2/5), 

2/5 := 2(~2/2 + 2/3 + 2/4-2/5)- 

Thus any weight A = poUo + PiUi + P22/2 + P^Vz + P42/4 + P52/5 ^ D{K2) can also be written as 
A = PoVg + Piyi + ^2^2 + ^3^3 + ^4^4 + ^5^5, where 

1 111, 
Po = - ^Po + 3pi, pi = --Po- -Pi, P2 = ^{P2+P3+Pa+ Ps), 

P3 =^(P2 +P3-P4- P5), P4 = ^{P2-P3+PA- Pb) , 
P5 =2(-P2 +P3 +P4 -P5)- 



Thus D{K2) has the following another expression: 

D{K2) =D{{S^ X Spin{2) ■ Spin{8))/Z^) 

={A = povo + piiii + P2y2 + ^3^3 + p4m + p^m e t* I 

^Po +P1+P2+P3+P4+P5 ^ 2Z, po e z, 
(pi,P2,P3,P4,P5) e + 1, 1, 1, 1), e = or ^, 

p2>P3>pA> \Pb\ }• 

Notice that the subgroup Ki = {S^ x {Spin{2) ■ {Spin{2) ■ Spin{Q)))) /Ti^^ also has the same 
maximal torus Tr-j = = = Tk and the corresponding maximal abelian subalgebra t^^ 
of ti is 

tti = k = {{Oo, k §2, k O4, k) \e,ER (1 = 0,1, 2, 3, 4, 5)} = te, = t, 

we get 

D{Ki) ={A = poyo + pivi + ^2^2 + Psm + Pm + Pbm e = t* | 
^Po + Pi + + P3 + P4 + P5 e 2Z, Po e Z, 

(pi,P2,P3,P4,P5) e Z^ + 1, 1, 1, 1), £ = or ^, 

Finally, the maximal torus of Kq = [S^ x Spin{6)) /Z2 is given as follows: 

-^i^o ={(e'^ ^ (cos — - egcg sm — )(cos — - 6763 sm — ) 

(cos — - egcio sin — )) | G R (i = 0, 3, 4, 5)}/Z2 C T^a = Tk 
and the corresponding maximal abelian subalgebra of is 

t(„ = {(^0, 0, 0, ^3, ^4, ^5) I G R (^ = 0, 3, 4, 5)} C tj, = t. 

Then 

D{Ko) ={A = goyo + ^3^3 + ^4^4 + gs^s e tj^ | 

^go + g3 + g4 + gs e 2Z, go e Z, 

(g3, g4, gs) e z^ + i, i), e = o or ^, 
g3 > g4 > Igsl }• 

11.10. Branching Laws. Based on the branching laws of {S0{2n + 2), 5*0(2) x 50(2^)) 
obtained by Tsukamoto ([IZ]), we formulate the following branching laws. 

Lemma 11.3 (Branching Law of {Spin (10), Spin (2) ■ Spin{8))). For each 

A = pm + P22/2 + PsVs + PiVi + Sp5y5 e D{Spin{10)), 



with S = 1 or — 1 and 

(Pi,P2,P3,P4,P5) e + 5(1, 1, 1, 1, 1), e = or ^, 

Pl>P2>P3>P4>P5> 0, 

Va contains an irreducible Spin(2) ■ Spin{8) -module with the highest weight 

A' = qiyi + q2y2 + gsZ/s + qm + S'q^y^ G D{Spin{2) ■ Spin{8)) 
with 6' = 1 or — 1 and 

{qi, q2, qs, g4, gs) eZ^ + e{l, 1, 1, 1, 1), e = or ^, 
g2 > gs > ^4 > gs > 0, 

if and only if A' satisfies the following conditions: 
(1) 

Pi + 1 > q2 > Ps - I, 
P2 + 1 > gs > P4 - 1, 

P3 + 1 > g4 > P5 - 1, 

P4 + 1 > g5 > 0. 

(2) The coefficient of X'^^ in the following power series expansion in X of 



does not vanish. Here 



i=l 





= Pi- max{p2, 


g2}, 




= min{p2,g2} - 


- max 




= mm{p3, gs} - 


- max 




= mm{pi,q^} - 


- max 


4 


= min{p5,g5}. 





Moreover its multiplicity is equal to the coefficient of X'^^ . 
Lemma 11.4 (Branching Law of {Spin{8), Spin{2) ■ Spin{6))). For each 

A = P22/2 + + P42/4 + Sp5y5 e D{Spin{8)), 

with 6 = 1 or — 1 and 

{P2,P3,P4,P5) e + £(1, 1, 1, 1), e = or ^, 

P2>P2.>PA>Pb> 0, 

Va contains an irreducible Spin{2) ■ Spin{6) -module with the highest weight 
A' = g2y2 + qsVs + g4y4 + S'p^y^ e D{Spin{2) ■ Spin{6)) 
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with 5' = 1 or — 1 and 



(^2, qs, q4, gs) eZ"^ + e{l, 1, 1, 1), e = or 



gs > ^4 > > 0. 

if and only if A' satisfies the following conditions: 



(2) The coefficient of X''^ 



X 



P2 
P3 
Pi 



1 > > P4 - 1, 

1 > g4 > P5 - 1, 

1 > gs > 0. 



n 

1=2 



X' 



X' 



X -x~ 



does not vanish. Here 



I2 := P2 - max{p3,g3}, 
£3 := min{p3, ^3} - max{p4, ^4}, 
£4 := mm{p4, q^} - max{p5, gs}, 
4 := mm{p5,g5}. 

Moreover its multiplicity is equal to the coefficient of X^"^ . 

11.11. Description of A'o). Let 

A' = Pol/0 + Pi 2/1 + P2Z/2 + P32/3 + PiVi + e'Ps^s 

= Po^o + Pi^i + P2^2 + Ps^a + PaVa + e'Ps^s e /^(i^2), 
A" = Po^o + P'l'yi + P2y2 + Psm + Ply A + e"P5^5 eD{K,), 
A'" = p;;'yo + m3 + Pry4 + e"'pl'm e D{K,). 
Assume that the corresponding representation spaces satisfy 

Vk D Wa' D f/A" = f/A'" ^ {0}. 
Suppose that Ua'" 7^ {0} is a trivial representation of Kq, that is, A'" = 0. Then we have 

^/// n '•III 'II n 'II n n 

Po = Po = 0' = Ps = 0' Pi =Pi = 0, P5 = P5 = 0. 

Thus A" = p'iyi+p'ih e D{Ki) with p'/, p'2' e Z, p'/ +#2' e 2Z. 
By the branching law of {Spin{8), Spin{2) ■ Spin{Q)), we get 

P2 > Ps = > P4, 

\ n \ 'I 

P3 > P4 = > P5, 

P4 



P5 = > 0. 
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Thus (P4,P5) = (0, 0) and p'2 > 0, p'^ > 0. It follows that 

£2 = P2 - max{p3,p3} = P2 - max{p3, 0} = P2 - Pg, 
£3 = min{p3,p3} — max{p4,]54} = minjpg, 0} — max{0, 0} = — = 0, 
£4 = min{p'4,p'4'} - max{p'5,p'5'} = mm{0, 0} - max{0, 0} = - = 0, 
£5 = mill {pg, 1)5} = min{0, 0} = 0. 

Then the coefficient of in the (finite) power series expansion in X 

i=2 

is equal to its multiplicity. Hence we have 

-(^2 - P3) < = P'2 - Ps - 2Z < ^2 - Ps 

for some i G Z with < i < — pg. Moreover, pj, = pQ = 0,p'i = p'/. Thus we get 

A' = PiVi + ^2^2 + Psm e D{K2) 

with 

p'l = Pi,P2,P3 e z, p'l +P2 +P3 e 2Z, 

- (P2 - Pa) < P2 = P2 - P3 - 2z < P2 - Ps 
for some ? G Z with < i < — Pg. Therefore, 

A' = PoVo + PiVi + P2Z/2 + + p'iVA + ep^y^ G D{K2) 

with 







- = -3pi, 




p'l = 




- 2^1 = -2^1' 


\{P'2+P',). 


J'2 = 


^(P2 


+ P3+P'4-e'P5) = 


Ps = 


^(P2 


+ P3-pl + e'P5) = 


\{P2+Pz)^ 


p; = 


i(^'2 


-p'a+Pl + e'Ps) = 


^(^2-^3)) 


ePs = 


\{P2 


-P-i-PA-^P^) = 


^(P2 -Ps)- 



In particular, e' = 1, p'2 = P3 = i(P2 +P3), p'^ = p'5 = |(P2 -Ps)- 

Then po = p'q and by the branching laws of (^^^^(lO), Spin{2) ■ Spin{8)), we get 

Pi > P2 > P3, P2 > P3 = p'2 > P4, 

P3 > P4 > P5, P4 > P5 = P4 > 0. 
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Thus pi > P2 > P2 = p's ^ Ps ^ Pa ^ p'4 = > Ps > 0. It follows that 

ii=pi- max{p2,P2} = Pi - P2, 

£2 = mm{p2,P2} - max{p3,p3} = p'^ - p'^ = 0, 

£3 = mm{p3,p'^} - max{p4,p4} = ps - Pi, 

4 = min{p4,p4} - max{p5,p5} = p'^ - p'^ = 0, 

£5 = min{p5,p5} = P5. 

Then the coefficient of X^'i = = X'^p" in the (finite) power series expansion in X 



VP1-P2 + I _ V-(Pl-P2 + l) VP3-P4 + 1 _ \"-(P3-P4 + l) 
_ vee'p^ 11 11 11 

P1-P2 P3-P4 

_J^«'P5 J^(Pl-P2) + (P3-P4)-2(i+i) 

i=0 j=0 

is equal to its multiplicity. 

Then we have A = po^/o + PiVi + ^2^/2 + Ps^s + + epsZ/s G ^(-f^, -f^o) with po = Po = 
-3p; = 6p; G 3Z. 

11.12. Eigenvalue computation. Recall that the standard basis = 0, 1,-- - ,5) of 

t = {(6'o, 6*1, 6^2, 6^3, 6^4, 6^5) I G R} corresponds to 2^/^R{2ei - 62 - 63) G u(l) and 
-v/^i?(e2 — 63), Di^4, L'1^12, -Di,36, -Di^57 G spm(lO), respectively. With respect to the inner 
product (n, f )u = — trwu for u, i; G t C eg C 0[(if3(K)*-^), 

(eo, eo) = 72, (e^, e^) = 6, (e„, ep) = 0, 

for 1 < z < 5 and < a 7^ /3 < 5. It follows that the inner products of the dual bases 
{yo, yi, 1/2, ys, Hi, ys} of t* corresponding to {eo, ei, e2, 63, 64, 65} of t are given by 

{yo.,yfs) = 0, i0<a^(3<5), 

{yo, yo) = {yi, yj) = ^, (i < ^ 7^ j < 5). 



For 



A = P02/0 + piyi + P2y2 + Psys + p^y^ + epsys e D{K, Kq), 

A' = povo + ^yi + P22/2 + ^2^3 + PI2/4 + plys 


= -jm + (P2 + ^'4)^2 + {P2 - P',)m e d{K2, Ko), 

A" = -jyi+meDiK,,K,), 
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the eigenvalue formulas of the Casimir operators Ck/Ko^ ^k-zIKq and Cxi/Xo with respect to the 
inner product ( , )u are given respectively by 



-CA = ^Vl + ^{(Pl + 8)Pl + {V2 + 6)P2 + (P3 + 4)P3 + (P4 + 2)P4 + (Ps)'}, 

7z o 



Then for each A e D{K^ Kq), we have the following eigenvalue formula 



-cl = -12ca + 6ca' + 3ca" 

= 2{(pi + 8)pi + {p2 + 6)p2 + (^3 + 4)p3 + (P4 + 2)p4 + (Ps)^} 

- {iP2 + Q)P2 + (P2 + 4)P'2 + + 2)^; + (P4)'} - ^(P2)' 

=2(pi + 8)pi + 2((p2)' - {p'2?) + 12P2 - lOp'2 + 2(p3)' + 8p3 
+ 2((p4)' - {p',r) + 4p4 - 2pl + 2(p5)' - liP'^' 

=2(pi + 8)pi + 2((p2)' - iP2?) + 2p2 + 10(P2 - P2) + 2(P3)' + 8P3 
+ 2((P4)' - (p'4)') + 2p4 + 2(p4 - p'd + 2{p,f - ]^{P'if 

>2(pi + 8)pi + 2p2 + 2(p3)' - \{P2f + 8P3 + 2p4 + 2(p5)' 

=2(pi + 8)pi + 2p2 + (2(p'5)' - ]^{p'iY) + 8p3 + 2p4 + 2(p5)' 
>2(pi + 8)pi + 2p2 + 8p3 + 2p4 + 2(p5)', 



where the equalities hold if and only if p2 = p'2: Pi = p'4, 2p3 = 2^4 = 2p'^ = 2p'^ = \p2\ since 
we have 



Pl>P2> P'2 = P'2. >P3>P4> Pa = Ph > P5 > 0, 

- 2^4 = -2^5 = -(p2 - P3) < P2 < P2 - P3 = 2P5 = 2^1- 
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Notice that if pi = 0, then —cl = and if pi > 2, then —cl > 40 > 30. In case pi = |, the 
possible A = {po,Pi,P2,P3,P4,P5) e D{K,Kq) are 



3333 3 3333 3 3333 1 3333 _1 

IPO; 2' 2' 2' 2' 2 2' 2' 2' 2' 2 2' 2' 2' 2' 2 2' 2' 2' 2' 2 

3 3 3 1 1 3 3 3 1 1 3 3 1 1 1 3 3 1 1 1 

\Poi 2' 2' 2' 2' 2 2' 2' 2' 2' 2 2' 2' 2' 2' 2 2' 2' 2' 2' 2 

3 1111 3 1 1 1 _1 

(Po, 2' 2' 2' 2' 2^' 2' 2' 2' 2' ^2^' 



In these cases, the eigenvalue of the Casimir operator is given by 



-CL >2(pi + 8)pi + 2p2 + 8p3 + 2p4 + 2(p5)' 

3 3 111 1 

>2 . (- + 8) ■ - + 2 ■ - + 8 ■ - + 2 ■ - + 2 ■ (-^ 

- ^2 ' 2 2 2 2 ^2' 

=35 > 30. 



Hence in order to decide the Hamiltonian stability, i.e., to compare the first eigenvalue —cl 
and 30, we can only concern on the cases when pi = | or 1. 

It follows from the description of D{K,Kq) that the element in D{K,Kq) when pi = | is 
given by 



11111 1111 1. 

(Po, 2' 2' 2' 2' r 2' 2' 2' 2' ~2' 



and the element in D{K, Kq) for pi = 1 is given by 



(po, 1, 0, 0, 0, 0), {po, 1,1,0, 0, 0), {po, 1,1,1, 0, 0), 
(po, 1, 1, 1, 1, 0), (po, 1, 1, 1, 1, 1) or (po, 1, 1, 1, 1, -1). 



Using the branching laws, the descriptions of D{K2, Kq), D{Ki,Kq) and the eigenvalue 
formula given above, by direct computation we get the following small eigenvalues in the 
above cases. 
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A 


A' 


A" 


-cl 


q i 1 i i i 

' 2 ' 2 ' 2 ' 2 ' 2 


q i i i i i 

' 2 ' 2 ' 2 ' 2 ' 2 


0,-1,1,0,0,0 


15 


q 1 1 1 1 1 
•3' 2' 2' 2' 2' 2 


q 1 1 1 1 1 

2' 2' 2' 2' 2 


0,-1,-1,0,0,0 


15 


q i i i 1 i 

' 2 ' 2 ' 2 ' 2 ' 2 


q i i i i i 

' 2 ' 2 ' 2 ' 2 ' 2 


0,1,1,0,0,0 


15 


q i i i 1 1 

' 2 ' 2 ' 2 ' 2 ' 2 


q i 1 1 i i 

' 2 ' 2 ' 2 ' 2 ' 2 


0,1,-1,0,0,0 


15 


6,1,0,0,0,0 


6,1,0,0,0,0 


0,-2,0,0,0,0 


18 


-6,1,0,0,0,0 


-6,-1,0,0,0,0 


0,2,0,0,0,0 


18 


0,1,1,0,0,0 


0,0,0,0,0,0 


0,0,0,0,0,0 


32 


0,1,1,0,0,0 


0,0,1,1,0,0 


0,0,0,0,0,0 


20 


6,1,1,1,0,0 


6,1,1,1,0,0 


0,-2,0,0,0,0 


30 


-6,1,1,1,0,0 


-6,-1,1,1,0,0 


0,2,0,0,0,0 


30 


0,1,1,1,1,0 


0,0,1,1,0,0 


0,0,0,0,0,0 


36 


0,1,1,1,1,0 


0,0,1,1,1,1 


0,0,0,0,0,0 


32 


0,1,1,1,1,0 


0,0,1,1,1,1 


0,0,2,0,0,0 


30 


0,1,1,1,1,0 


0,0,1,1,1,1 


0,0,-2,0,0,0 


30 


6,1,1,1,1,1 


6,1,1,1,1,1 


0,-2,2,0,0,0 


32 


6,1,1,1,1,1 


6,1,1,1,1,1 


0,-2,-2,0,0,0 


32 


6,1,1,1,1,1 


6,1,1,1,1,1 


0,-2,0,0,0,0 


34 


-6,1,1,1,1,-1 


-6,-1,1,1,1,1 


0,2,2,0,0,0 


32 


-6,1,1,1,1,-1 


-6,-1,1,1,1,1 


0,2,-2,0,0,0 


32 


-6,1,1,1,1,-1 


-6,-1,1,1,1,1 


0,2,0,0,0,0 


34 



Here, A = (^0,^1,^2,^3,^4,^5) e D{K,Ko), A' = (Po,K,P2,P3'P4,P5) ^ ^(^2,^0) and A" = 

Since Ai = (3, |, |, |, |, |) corresponds to the complexified isotropy representation of EIII 
and it is conjugate to A2 = (—3, |, |, |, |, — |), we see tliat Ai, A2 ^ D{K, K[a])- 

Suppose that A = {po, Pi, P2, Ps, P4., P5) = (6, 1, 0, 0, 0, 0) G D{K, Kq). Then by the branching 
laws we get A' = Qyo + yi e D{K2, Kq), A" = -2yi e D{Ki, Kq) and A'" = e D{Ko). Hence, 
the eigenvalue of the Casimir operator is —cl = 18 < 30. 

On the other hand, 



V^A={ 6 |6,e3GC,a;iGK^|=C 

D Wa> = t/A" = f/A'" = {Va)ko 



10 



and Pa = ^ ctqio, where ac^o denotes the standard representation of S'O(IO), and for each 

e f/(l). 












^0 











Xi 









°\ 

Xi 




Xi 






^0 


Xi 


6/ 
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where 9 = e^^^l"^ , Since for any exp(tov^-R(ei - 2e2 + 63)) ^ C Kq, 
exp(to\/-T-R(ei - 2e2 + 63)) 

= exp(to-V^-R(2ei - 62 - 63)) exp(-to-A/^/?(e2 - 63)) 



we compute 



In particular, 



G U{1) ■ Spin{2) C K, 



/O 

PA(exp(toV^i?(ei - 2e2 + 63))) ^2 Xi 

\0 X, ^3, 

/O 

= (/i6 K acio)(exp(tov^^(ei - 2e2 + 63))) 6 

VO X, ^3, 

1 3 /"^ 

=/i6(exp(to-v^^(2ei - 62 - e3)))a23(-42) 6 ^1 

\0 xi ^3, 



^0 

.0 xi 





-Itoi 
















-If to j 




/^to 










Xi 


























^fto 







-ifto^^ 




^3 



_Xi 
-Ito^ 



Xi 



^0 

PA(exp(toV-li?(ei - 262 + 63))) | 

.0 6. 



^0 


.0 ^3. 



for each to ^ R- Hence, 

TOi^o= |6eC . 
AO W 

But as a generator of Z4 of the action of a23(vr)(ai, 02, 03) G -ft'fn] given by f lll.26p is 



/O 

PA(a23(7r)(ai,a2,a3)) 

\0 ^3. 

/O 0\ /O 

= («23(vr)) = 

\o ^3/ VO -^3. 
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Therefore (yA)^,„j = {0} and A = Qy^+yi ^ D{K, K^,]). Similarly, A = -6yo+yi ^ D{K, 

Suppose A = {po, pi, P2, Ps, Pa, P5) = (0, 1, 1, 0, 0, 0) G D{K, Kq). Then by the branching laws 
we get 

A' = (p'o,p'i,p'2,P3,p'4,P5) = (0,0,l,l,0,0)G 1^(7^2, i^o), 

A" = (p^,^p;^p'2^P3^pl^pD = (o,o,o,o,o,o)GD(i^l,iro). 

Here p^, = Id K Id K ^^%in{%) = Id K Id K Ad50(8) ^ V{K2). Notice that Wk> = o{8)^ = 
0(2)^ © o(6)<^ © M(2, 6; R)<^, and the subgroups U{1) and Spin{2) of K2 = x {Spin{2) ■ 

Spin{8))/Z4 acts trivially on 0(8)'-'. The subgroup Spin{6) of Spin{2) ■ Spin{Q) acts trivially 
on 0(2)*-^, hence {Wa')ko = o(2)^- For a23(7r)(ai, 0^2, as) G Kia] a generator of Z4 given in 
(111 ■261) . a23(7r) and (01,02,03) commute to each other. a23(7r) G Spin{2) acts trivially on 

0(2)*^. ^2 of (ai,a;2,a3) acts on Rl + Re as ( ] and preserves the vector subspace 





orthogonally complementary to Rl + Re in K = R®. Thus the S'pm(2)-factor of (01,02,03) 

in Spin{2) ■ Spin{6) corresponds to ^ G 0(2). Since its adjoint action of on o(2)*^ is 

—Id, the adjoint action of (ai, 02, Q3) G Spin{8) is not trivial on 0(2)*-^. Hence (Wa')ki„] = {0} 
and in particular we obtain A = yi + y2 ^ D{K, K[a])- 

Suppose A = (po,Pi,P2,P3,P4,P5) = (6,1,1,1,0,0) G D{K,Ko). Then dime Va = 120. 
By the branching laws we get A' = 6yo + Z/i + Z/2 + 1/3 = -2^i + m + e D{K2,Ko), 
A" = —2yi G D{Ki,Kq) and A'" = G D{Kq). Hence, the eigenvalue of the Casimir operator 
is —cl = 30. 

On the other hand, p^, = Id K /i_2 ^ Ad§,i„(8) = W K ^ Ad5o(8) ^ ^^(^'2)- Here W^i = 
0(8)*^ = 0(2)*^ © 0(6)^ © M(2,6;R)^. Same as the previous case, we get (IVa')xo = o{2)^. 
Notice that for the generator Q!23(7r)(ai, 02, 03) of Z4 in K[a] given by (lll.26p . the action of 
«23(7r) G Spin{2) on if3(K*-') is given by 





X3 


X2 \ 




2:3 




Xi 


H 


V X2 









e,i \/-ix3 ■ 
r^x3 -^2 

\f—\X2 X\ 

In particular, 023(71") transforms U2 to — V— 1'"2 and en2 to —\J—\q.U2, which says that 
a23(vr) acts on o(2) = Rl + Re as the matrix multiplication by [ ^ ^ ^ — - ). Thus 




-V-1 , 

/i_2(a23(7r)) acts on o(2) = Rl + Re is just the matrix multiplication by —Id. On the other 
hand, 02 of 0.2, 0L3) acts on Rl + Re as ^ . Thus the S'pm(2)-factor of {a\, 0:2, 03) 

in Spin{2) ■ Spin{6) corresponds to ^ G 0(2). Hence its adjoint action on o(2)*^ is 

-Id. Therefore, {Va)k^^^ = o{2)^, i.e., A = 6yo + Z/i + Z/2 + Z/3 e D{K,K^,]) = o{2)^. Thus 
A = 6?/o + 1/1 + 2/2 + 2/3 e D{K, K[a]) with multiplicity 1. Similarly, A = -6yo + yi + ^2 + 2/3 G 
D{K,Kia]) with multiplicity 1. 

Suppose A = {po,Pi,P2,P3,P4,P5) = (0,1,1,1,1,0) G D{K,Kq). Then dime Va. = 210. By 
the branching laws we get the following decomposition of Va into irreducible modules of K2 



and Ki. 



^(0,1,1,1,1,0) 
= W^A;(0,0,1, 1,1,1) 



W^A^{0,0,1, 1,0,0) 



— (f^A'/{0,0,0,0,0,0) © f^A'/(0,0,2,0,0,0) © f^A'/{0,0,-2,0,0,0)) © f^A'j' (0,0,0,0,0,0) • 

Then the Casimir operator —Cl has eigenvalues —cl = 32, 30, 30 or 36 along this decomposi- 
tion. 

On the other hand, A; = 2^2 e D(i^2, Ko), Wa[ = S^{C^) ^ S^{K^) and 

'/(0,0,0,0,0,0) 'i' (0,0,2,0,0,0) )-fs:o © (^A'/(0,0,-2,0,0,0))xo- 

Recall that {1, Ci, ■ ■ ■ , Cy} denote the standard basis of the Cayley algebra K and e := C4. 
Then 



3(1 ■ 1 + e ■ e) - (ci ■ Cl + C2 ■ C2 + C3 ■ C3 + C5 ■ C5 + C6 ■ C6 + C7 ■ C7) G S'o(K^). 



For any A 



( 



cos t — sin t 
\sint cost 



G^0(2), A(l,e) = (l,e; 



/ cos t — sin t 
Isint cost 



Hence 



A(l ■ 1) =(costl + sinte) ■ (costl + sinte) 

= cos^ t{l ■ 1) + sin^ tie. ■ e) + 2 sin t cost(l ■ e), 

A[e ■ e) =(— sintl + coste) ■ (— sintl + coste) 

= sin^t(l ■ 1) + cos^t(e ■ e) - 2sintcost(l ■ e), 

A{1 ■ e) =(costl + sinte) ■ (— sintl + coste) 

= - ^ sin2t(l ■ 1 - e ■ e) + cos2t(l ■ e). 

In particular, A{1 ■l + e-e) = l- l + e- e and 

A(3(l ■ 1 + e ■ e) - (ci ■ Cl + C2 ■ C2 + C3 ■ C3 + C5 ■ C5 + C6 ■ C6 + C7 ■ C7)) 
=3(1 ■ 1 + e ■ e) - (ci ■ Cl + C2 ■ C2 + C3 ■ C3 + C5 ■ C5 + C6 ■ C6 + C7 ■ C7). 

Thus, 3(1 ■ 1 + e ■ e) - (ci ■ Cl + C2 ■ C2 + C3 ■ C3 + C5 ■ C5 + ce • C6 + C7 ■ C7) G ?7a" (0,0,0,0,0,0)- On the 
other hand, 1 ■ 1 - e ■ e - 2y/~-[{l ■ e), 1 ■ 1 - e ■ e + 2a/^(1 ■ e) G S'o(K*^), and we see that 



,-v^2t/ 



gv "*(l.l-e-e 



Hence, 1 ■ 1 — e ■ e 
Therefore, 



A(l-l-e-e-2V-ll-e) 
A(l ■ 1 - e ■ e + 2v^l ■ e) = e^^^t^^ . ^ 

2v^— Tl ■ e G f/A" (0,0,2,0,0,0), 1 ■ 1 — e ■ e + 2a/^1 ■ e G f/A"(o,o,-2,o,o,o)- 



2V-11 ■ e), 
e-e + 2v^l-e). 



= C(3(l ■ 1 + e ■ e) - (ci ■ Cl + C2 ■ C2 + C3 ■ C3 + C5 • C5 + C6 • C6 + C7 ■ C7)) 
© C(l ■ 1 - e ■ e - 2v^l ■ e) 
©C(l-l-e-e + 2v^l-e). 
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Since the action of the generator a23(vr)(ai, 02, as) is given by 

(a23(7r)(ai, ^2, «3))(2v^(l • e)) = 2(v^e ■ (-1)) = -2^/^(1 ■ e), 
(a23(7r)(ai, 02, a3))(l ■l-e-e) = l- l- e-e, 
(a23(7r)(ai, aa, a3))(l ■ 1 + e ■ e) = -(1 ■ 1 + e ■ e), 

we obtain 

(VA)xMnH^Ai = C(l-l-e-e), 

and thus A = 2/2+1/3 +2/4 € /^(-ft', -f^[a]), which has eigenvalue 30 of —Cl with the muhiphcity 
1. Therefore, 

n(L^°) = dime 1,1,0,0) + dime V(_6,i, 1,1,0,0) + dime V(o,i,i, 1,0,0) 
= 120 + 120 + 210 = 450 

= dim 50(32) - dimf/(l) ■ Spin{10) = nki{L^^). 
Then we conclude that 
Theorem. The Gauss image 

= (t/(l) ■ Spin{lQ))l{S^ ■ Spin{<6) ■ Z4) C g3o(C) 
is strictly Hamiltonian stable. 
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